Skip to content

[WIP] Experiment - #8842

Draft
AdamGS wants to merge 6 commits into
developfrom
adamg/try-not-re-filter
Draft

[WIP] Experiment#8842
AdamGS wants to merge 6 commits into
developfrom
adamg/try-not-re-filter

Conversation

@AdamGS

@AdamGS AdamGS commented Jul 17, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

  • Closes: #000

What changes are included in this PR?

What APIs are changed? Are there any user-facing changes?

AdamGS added 6 commits July 18, 2026 00:39
@AdamGS
feat(vortex-array): add comparison satisfiers
43b8211 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
perf(vortex-layout): skip all-false chunk filters
49b9557 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
perf(vortex-layout): skip satisfied zone filters
1b04ccc 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
refactor(vortex-file): share file stats proofs
a7c6864 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
perf(vortex-file): skip satisfied file filters
ac183c6 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
style: format filter satisfier changes
acebb2f 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jul 17, 2026
@github-actions github-actions Bot removed the action/benchmark-sql-full Run SQL benchmarks with vortex-compact and SF=10 label Jul 17, 2026
@AdamGS AdamGS added the changelog/feature A new feature label Jul 18, 2026
@github-actions

github-actions Bot commented Jul 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done acebb2f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+4.1%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 1.056x ➖
Parquet (geomean): 1.048x ➖
Shifts: Parquet (control) +4.8% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.115x ❌, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 🚨 10320403 9222307 1.12
vortex_q01/datafusion:vortex-file-compressed 🚨 6674034 6003507 1.11
datafusion / parquet (1.071x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 21371005 20168593 1.06
vortex_q01/datafusion:parquet 4964853 4585156 1.08
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 9391507 9919645 0.95
vortex_q01/duckdb:vortex-file-compressed 6397534 5876722 1.09
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 23774293 23121933 1.03
vortex_q01/duckdb:parquet 9514218 9295209 1.02

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.002x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 110408920 117034916 0.94
polarsignals_q01/datafusion:vortex-file-compressed 262219152 274486415 0.96
polarsignals_q02/datafusion:vortex-file-compressed 23594161 24704495 0.96
polarsignals_q03/datafusion:vortex-file-compressed 281636331 273618741 1.03
polarsignals_q04/datafusion:vortex-file-compressed 9719410 9293672 1.05
polarsignals_q05/datafusion:vortex-file-compressed 15224973 14525381 1.05
polarsignals_q06/datafusion:vortex-file-compressed 20992500 21242656 0.99
polarsignals_q07/datafusion:vortex-file-compressed 14516597 13242247 1.10
polarsignals_q08/datafusion:vortex-file-compressed 390152663 390105494 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11437877 11848073 0.97

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-2.7%, low confidence)
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51545939 53852195 0.96
tpch_q02/datafusion:vortex-file-compressed 22917989 23240440 0.99
tpch_q03/datafusion:vortex-file-compressed 30313823 31401434 0.97
tpch_q04/datafusion:vortex-file-compressed 19424765 19850715 0.98
tpch_q05/datafusion:vortex-file-compressed 45860223 45894493 1.00
tpch_q06/datafusion:vortex-file-compressed 10027184 9958533 1.01
tpch_q07/datafusion:vortex-file-compressed 52131407 53120210 0.98
tpch_q08/datafusion:vortex-file-compressed 38713611 39076229 0.99
tpch_q09/datafusion:vortex-file-compressed 50848898 51361067 0.99
tpch_q10/datafusion:vortex-file-compressed 33291505 32855541 1.01
tpch_q11/datafusion:vortex-file-compressed 16283281 16586406 0.98
tpch_q12/datafusion:vortex-file-compressed 23905277 23917163 1.00
tpch_q13/datafusion:vortex-file-compressed 25734886 26042874 0.99
tpch_q14/datafusion:vortex-file-compressed 14649762 15316307 0.96
tpch_q15/datafusion:vortex-file-compressed 22590361 22897414 0.99
tpch_q16/datafusion:vortex-file-compressed 19931870 20099305 0.99
tpch_q17/datafusion:vortex-file-compressed 65451518 66104332 0.99
tpch_q18/datafusion:vortex-file-compressed 73424064 76874031 0.96
tpch_q19/datafusion:vortex-file-compressed 19200539 18209081 1.05
tpch_q20/datafusion:vortex-file-compressed 30290868 30863134 0.98
tpch_q21/datafusion:vortex-file-compressed 67696891 70485631 0.96
tpch_q22/datafusion:vortex-file-compressed 11743611 12189073 0.96
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61025744 61504436 0.99
tpch_q02/datafusion:vortex-compact 25775872 26067691 0.99
tpch_q03/datafusion:vortex-compact 33234161 34734231 0.96
tpch_q04/datafusion:vortex-compact 22953336 23292035 0.99
tpch_q05/datafusion:vortex-compact 48473753 47784960 1.01
tpch_q06/datafusion:vortex-compact 12676119 12658022 1.00
tpch_q07/datafusion:vortex-compact 56239737 56296747 1.00
tpch_q08/datafusion:vortex-compact 42736627 42800434 1.00
tpch_q09/datafusion:vortex-compact 54605428 55928730 0.98
tpch_q10/datafusion:vortex-compact 38840283 37941991 1.02
tpch_q11/datafusion:vortex-compact 17417995 17764150 0.98
tpch_q12/datafusion:vortex-compact 31049356 31631996 0.98
tpch_q13/datafusion:vortex-compact 32068559 31947355 1.00
tpch_q14/datafusion:vortex-compact 18592733 19197274 0.97
tpch_q15/datafusion:vortex-compact 30560858 30350455 1.01
tpch_q16/datafusion:vortex-compact 22250412 23715095 0.94
tpch_q17/datafusion:vortex-compact 70119281 69475566 1.01
tpch_q18/datafusion:vortex-compact 79461771 81258395 0.98
tpch_q19/datafusion:vortex-compact 38838353 37229413 1.04
tpch_q20/datafusion:vortex-compact 34635093 34394542 1.01
tpch_q21/datafusion:vortex-compact 79303180 79551818 1.00
tpch_q22/datafusion:vortex-compact 13208380 13187455 1.00
datafusion / parquet (0.986x ➖, 1↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 120664831 143748207 0.84
tpch_q02/datafusion:parquet 61281861 61864933 0.99
tpch_q03/datafusion:parquet 82532579 81742325 1.01
tpch_q04/datafusion:parquet 47534710 48991487 0.97
tpch_q05/datafusion:parquet 96599956 95531013 1.01
tpch_q06/datafusion:parquet 43666173 43422606 1.01
tpch_q07/datafusion:parquet 105783523 102881721 1.03
tpch_q08/datafusion:parquet 93777760 96848049 0.97
tpch_q09/datafusion:parquet 127317977 124688856 1.02
tpch_q10/datafusion:parquet 118479071 119607401 0.99
tpch_q11/datafusion:parquet 40943651 42185437 0.97
tpch_q12/datafusion:parquet 83229055 79338172 1.05
tpch_q13/datafusion:parquet 189642519 197394488 0.96
tpch_q14/datafusion:parquet 45674838 45779004 1.00
tpch_q15/datafusion:parquet 59481108 61954171 0.96
tpch_q16/datafusion:parquet 42256965 42842688 0.99
tpch_q17/datafusion:parquet 143762885 143246760 1.00
tpch_q18/datafusion:parquet 149144141 156701867 0.95
tpch_q19/datafusion:parquet 73213447 72974665 1.00
tpch_q20/datafusion:parquet 69740159 67930232 1.03
tpch_q21/datafusion:parquet 140986937 144521377 0.98
tpch_q22/datafusion:parquet 43895525 44684509 0.98
datafusion / arrow (0.974x ➖, 1↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 54182358 66301702 0.82
tpch_q02/datafusion:arrow 16468448 17049455 0.97
tpch_q03/datafusion:arrow 31946032 31727279 1.01
tpch_q04/datafusion:arrow 26093932 26836904 0.97
tpch_q05/datafusion:arrow 55405528 56724902 0.98
tpch_q06/datafusion:arrow 21385680 20909852 1.02
tpch_q07/datafusion:arrow 105000838 105226649 1.00
tpch_q08/datafusion:arrow 41914410 42721999 0.98
tpch_q09/datafusion:arrow 64166176 68530798 0.94
tpch_q10/datafusion:arrow 48075443 53055231 0.91
tpch_q11/datafusion:arrow 9142613 9293821 0.98
tpch_q12/datafusion:arrow 47836634 49564897 0.97
tpch_q13/datafusion:arrow 45851441 47293659 0.97
tpch_q14/datafusion:arrow 22930069 23464671 0.98
tpch_q15/datafusion:arrow 44841876 46573566 0.96
tpch_q16/datafusion:arrow 16042674 16549613 0.97
tpch_q17/datafusion:arrow 67362797 67003408 1.01
tpch_q18/datafusion:arrow 106867944 111522265 0.96
tpch_q19/datafusion:arrow 38451644 36518679 1.05
tpch_q20/datafusion:arrow 36156845 35410311 1.02
tpch_q21/datafusion:arrow 155269419 155165905 1.00
tpch_q22/datafusion:arrow 12194738 12106165 1.01
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 26826750 27174903 0.99
tpch_q02/duckdb:vortex-file-compressed 25004836 24908127 1.00
tpch_q03/duckdb:vortex-file-compressed 30907478 32438219 0.95
tpch_q04/duckdb:vortex-file-compressed 27307660 27767250 0.98
tpch_q05/duckdb:vortex-file-compressed 34900034 34805138 1.00
tpch_q06/duckdb:vortex-file-compressed 8559048 8513390 1.01
tpch_q07/duckdb:vortex-file-compressed 32833840 33433004 0.98
tpch_q08/duckdb:vortex-file-compressed 38028661 39051416 0.97
tpch_q09/duckdb:vortex-file-compressed 53166116 55539838 0.96
tpch_q10/duckdb:vortex-file-compressed 40296664 40754612 0.99
tpch_q11/duckdb:vortex-file-compressed 14038470 13699155 1.02
tpch_q12/duckdb:vortex-file-compressed 23329222 23125125 1.01
tpch_q13/duckdb:vortex-file-compressed 38721077 38988243 0.99
tpch_q14/duckdb:vortex-file-compressed 19362945 20443052 0.95
tpch_q15/duckdb:vortex-file-compressed 16116782 16120695 1.00
tpch_q16/duckdb:vortex-file-compressed 27301606 27467521 0.99
tpch_q17/duckdb:vortex-file-compressed 22595965 22955492 0.98
tpch_q18/duckdb:vortex-file-compressed 50001534 51630643 0.97
tpch_q19/duckdb:vortex-file-compressed 25263691 25704982 0.98
tpch_q20/duckdb:vortex-file-compressed 30900809 30827715 1.00
tpch_q21/duckdb:vortex-file-compressed 96301300 99425796 0.97
tpch_q22/duckdb:vortex-file-compressed 15903714 16163429 0.98
duckdb / vortex-compact (0.976x ➖, 1↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 36790316 38274017 0.96
tpch_q02/duckdb:vortex-compact 32952275 32013573 1.03
tpch_q03/duckdb:vortex-compact 34014804 35138986 0.97
tpch_q04/duckdb:vortex-compact 33954111 34452106 0.99
tpch_q05/duckdb:vortex-compact 38947078 40060089 0.97
tpch_q06/duckdb:vortex-compact 10259483 10917991 0.94
tpch_q07/duckdb:vortex-compact 41816161 41894841 1.00
tpch_q08/duckdb:vortex-compact 43375927 47003225 0.92
tpch_q09/duckdb:vortex-compact 🚀 60461136 68036176 0.89
tpch_q10/duckdb:vortex-compact 47117472 47235286 1.00
tpch_q11/duckdb:vortex-compact 15779839 16340678 0.97
tpch_q12/duckdb:vortex-compact 31711740 31601906 1.00
tpch_q13/duckdb:vortex-compact 44547897 46804129 0.95
tpch_q14/duckdb:vortex-compact 22442892 23376881 0.96
tpch_q15/duckdb:vortex-compact 19423405 19878909 0.98
tpch_q16/duckdb:vortex-compact 29695114 29327118 1.01
tpch_q17/duckdb:vortex-compact 27967978 27692194 1.01
tpch_q18/duckdb:vortex-compact 57251388 59040719 0.97
tpch_q19/duckdb:vortex-compact 29179155 29106939 1.00
tpch_q20/duckdb:vortex-compact 38123360 37537967 1.02
tpch_q21/duckdb:vortex-compact 108949929 113299606 0.96
tpch_q22/duckdb:vortex-compact 17376333 17677948 0.98
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79746242 77681014 1.03
tpch_q02/duckdb:parquet 39623887 40035658 0.99
tpch_q03/duckdb:parquet 71024856 71343602 1.00
tpch_q04/duckdb:parquet 49707470 50366914 0.99
tpch_q05/duckdb:parquet 68687992 69384390 0.99
tpch_q06/duckdb:parquet 22842613 22681841 1.01
tpch_q07/duckdb:parquet 77049061 71334164 1.08
tpch_q08/duckdb:parquet 82747410 83478070 0.99
tpch_q09/duckdb:parquet 🚨 160499362 136801305 1.17
tpch_q10/duckdb:parquet 133480736 134719480 0.99
tpch_q11/duckdb:parquet 22857608 22929061 1.00
tpch_q12/duckdb:parquet 47409860 47649740 0.99
tpch_q13/duckdb:parquet 253901476 253189395 1.00
tpch_q14/duckdb:parquet 52081090 51498944 1.01
tpch_q15/duckdb:parquet 29244030 28864207 1.01
tpch_q16/duckdb:parquet 58118193 58701154 0.99
tpch_q17/duckdb:parquet 59552226 58598026 1.02
tpch_q18/duckdb:parquet 122890119 121701071 1.01
tpch_q19/duckdb:parquet 77505665 72887807 1.06
tpch_q20/duckdb:parquet 66051497 66668112 0.99
tpch_q21/duckdb:parquet 172461415 175987978 0.98
tpch_q22/duckdb:parquet 55221995 55946295 0.99
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17897580 17735483 1.01
tpch_q02/duckdb:duckdb 14491157 14522826 1.00
tpch_q03/duckdb:duckdb 21985605 22931390 0.96
tpch_q04/duckdb:duckdb 22215127 22520633 0.99
tpch_q05/duckdb:duckdb 23304338 23544044 0.99
tpch_q06/duckdb:duckdb 7057140 7087714 1.00
tpch_q07/duckdb:duckdb 25388811 25843135 0.98
tpch_q08/duckdb:duckdb 24011647 24361693 0.99
tpch_q09/duckdb:duckdb 57823452 58726489 0.98
tpch_q10/duckdb:duckdb 51715375 50733004 1.02
tpch_q11/duckdb:duckdb 7082785 7244608 0.98
tpch_q12/duckdb:duckdb 17565266 18052696 0.97
tpch_q13/duckdb:duckdb 39353775 39873075 0.99
tpch_q14/duckdb:duckdb 21724963 21340867 1.02
tpch_q15/duckdb:duckdb 13661908 13650012 1.00
tpch_q16/duckdb:duckdb 25991503 26598543 0.98
tpch_q17/duckdb:duckdb 16487105 16163714 1.02
tpch_q18/duckdb:duckdb 40636011 40729525 1.00
tpch_q19/duckdb:duckdb 30968577 31186584 0.99
tpch_q20/duckdb:duckdb 25457667 25482973 1.00
tpch_q21/duckdb:duckdb 60965415 61904056 0.98
tpch_q22/duckdb:duckdb 26168672 26238674 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+2.6%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): 1.004x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5018171 4933528 1.02
fineweb_q01/datafusion:vortex-file-compressed 33819229 34385483 0.98
fineweb_q02/datafusion:vortex-file-compressed 37700675 37865067 1.00
fineweb_q03/datafusion:vortex-file-compressed 58359654 53428176 1.09
fineweb_q04/datafusion:vortex-file-compressed 245716385 242394062 1.01
fineweb_q05/datafusion:vortex-file-compressed 185116221 185394936 1.00
fineweb_q06/datafusion:vortex-file-compressed 51302456 48295399 1.06
fineweb_q07/datafusion:vortex-file-compressed 56223826 56952765 0.99
fineweb_q08/datafusion:vortex-file-compressed 23095132 21630733 1.07
datafusion / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5482197 5254902 1.04
fineweb_q01/datafusion:vortex-compact 97220388 97470214 1.00
fineweb_q02/datafusion:vortex-compact 111602913 106703764 1.05
fineweb_q03/datafusion:vortex-compact 850277861 856962953 0.99
fineweb_q04/datafusion:vortex-compact 912277680 926908550 0.98
fineweb_q05/datafusion:vortex-compact 810071061 803070903 1.01
fineweb_q06/datafusion:vortex-compact 456143974 462548215 0.99
fineweb_q07/datafusion:vortex-compact 477806978 473574169 1.01
fineweb_q08/datafusion:vortex-compact 21094452 19869900 1.06
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6537806 7018548 0.93
fineweb_q01/datafusion:parquet 286466958 295055340 0.97
fineweb_q02/datafusion:parquet 286236782 295606447 0.97
fineweb_q03/datafusion:parquet 299141647 277097080 1.08
fineweb_q04/datafusion:parquet 307857473 301954597 1.02
fineweb_q05/datafusion:parquet 293649673 306492762 0.96
fineweb_q06/datafusion:parquet 297015026 294123479 1.01
fineweb_q07/datafusion:parquet 281234453 284512464 0.99
fineweb_q08/datafusion:parquet 280739988 275111626 1.02
duckdb / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 2926556 3369844 0.87
fineweb_q01/duckdb:vortex-file-compressed 32710936 33667536 0.97
fineweb_q02/duckdb:vortex-file-compressed 37186475 38257387 0.97
fineweb_q03/duckdb:vortex-file-compressed 103145288 100591434 1.03
fineweb_q04/duckdb:vortex-file-compressed 238792088 237733916 1.00
fineweb_q05/duckdb:vortex-file-compressed 181763755 186930992 0.97
fineweb_q06/duckdb:vortex-file-compressed 54095456 53882863 1.00
fineweb_q07/duckdb:vortex-file-compressed 55079401 52383314 1.05
fineweb_q08/duckdb:vortex-file-compressed 20280970 20707503 0.98
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 2968928 3033833 0.98
fineweb_q01/duckdb:vortex-compact 105285524 103326734 1.02
fineweb_q02/duckdb:vortex-compact 112675992 115433930 0.98
fineweb_q03/duckdb:vortex-compact 846934829 850432671 1.00
fineweb_q04/duckdb:vortex-compact 899576536 901364178 1.00
fineweb_q05/duckdb:vortex-compact 802371500 804045873 1.00
fineweb_q06/duckdb:vortex-compact 450840225 464048949 0.97
fineweb_q07/duckdb:vortex-compact 484689969 483165171 1.00
fineweb_q08/duckdb:vortex-compact 21610154 20940160 1.03
duckdb / parquet (0.997x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30847448 33419520 0.92
fineweb_q01/duckdb:parquet 93412669 89734129 1.04
fineweb_q02/duckdb:parquet 89329897 88840104 1.01
fineweb_q03/duckdb:parquet 317469175 323119256 0.98
fineweb_q04/duckdb:parquet 450141096 446834986 1.01
fineweb_q05/duckdb:parquet 420026133 420276635 1.00
fineweb_q06/duckdb:parquet 206482451 206757481 1.00
fineweb_q07/duckdb:parquet 218398568 217285745 1.01
fineweb_q08/duckdb:parquet 38189339 37714209 1.01

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+2.4%, low confidence)
Vortex (geomean): 1.037x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +2.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.039x ➖, 0↑ 8↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25316921 25423983 1.00
tpcds_q02/datafusion:vortex-file-compressed 47690410 47734597 1.00
tpcds_q03/datafusion:vortex-file-compressed 🚨 17965380 16228225 1.11
tpcds_q04/datafusion:vortex-file-compressed 256429223 242856018 1.06
tpcds_q05/datafusion:vortex-file-compressed 🚨 49554225 44073033 1.12
tpcds_q06/datafusion:vortex-file-compressed 24606373 25467500 0.97
tpcds_q07/datafusion:vortex-file-compressed 46615871 45846004 1.02
tpcds_q08/datafusion:vortex-file-compressed 34251891 31389508 1.09
tpcds_q09/datafusion:vortex-file-compressed 33923949 33671299 1.01
tpcds_q10/datafusion:vortex-file-compressed 🚨 44272716 40084577 1.10
tpcds_q11/datafusion:vortex-file-compressed 144347626 139509168 1.03
tpcds_q12/datafusion:vortex-file-compressed 20045519 18291672 1.10
tpcds_q13/datafusion:vortex-file-compressed 🚨 48547958 43863555 1.11
tpcds_q14/datafusion:vortex-file-compressed 174111025 166131846 1.05
tpcds_q15/datafusion:vortex-file-compressed 27785641 27062455 1.03
tpcds_q16/datafusion:vortex-file-compressed 26347652 25621459 1.03
tpcds_q17/datafusion:vortex-file-compressed 65623491 63091336 1.04
tpcds_q18/datafusion:vortex-file-compressed 64498110 63114376 1.02
tpcds_q19/datafusion:vortex-file-compressed 25116903 23691308 1.06
tpcds_q20/datafusion:vortex-file-compressed 🚨 23452305 21202408 1.11
tpcds_q21/datafusion:vortex-file-compressed 39231730 38108837 1.03
tpcds_q22/datafusion:vortex-file-compressed 🚨 156163948 134633337 1.16
tpcds_q23/datafusion:vortex-file-compressed 169549843 160463169 1.06
tpcds_q24/datafusion:vortex-file-compressed 93838022 90633621 1.04
tpcds_q25/datafusion:vortex-file-compressed 67549323 67950234 0.99
tpcds_q26/datafusion:vortex-file-compressed 🚨 35190208 31972829 1.10
tpcds_q27/datafusion:vortex-file-compressed 103397247 102078386 1.01
tpcds_q28/datafusion:vortex-file-compressed 36085341 35397392 1.02
tpcds_q29/datafusion:vortex-file-compressed 65658759 61636488 1.07
tpcds_q30/datafusion:vortex-file-compressed 25157640 24977190 1.01
tpcds_q31/datafusion:vortex-file-compressed 78947839 73726991 1.07
tpcds_q32/datafusion:vortex-file-compressed 20720367 19347000 1.07
tpcds_q33/datafusion:vortex-file-compressed 31375098 31177964 1.01
tpcds_q34/datafusion:vortex-file-compressed 29047599 27377640 1.06
tpcds_q35/datafusion:vortex-file-compressed 49297910 46536766 1.06
tpcds_q36/datafusion:vortex-file-compressed 63347902 63890548 0.99
tpcds_q37/datafusion:vortex-file-compressed 21454184 22718179 0.94
tpcds_q38/datafusion:vortex-file-compressed 43296459 42235551 1.03
tpcds_q39/datafusion:vortex-file-compressed 120172117 118241410 1.02
tpcds_q40/datafusion:vortex-file-compressed 32094771 31279888 1.03
tpcds_q41/datafusion:vortex-file-compressed 23743240 22111618 1.07
tpcds_q42/datafusion:vortex-file-compressed 15903464 15245455 1.04
tpcds_q43/datafusion:vortex-file-compressed 20659636 20133509 1.03
tpcds_q44/datafusion:vortex-file-compressed 33036862 33404438 0.99
tpcds_q45/datafusion:vortex-file-compressed 27881995 26261356 1.06
tpcds_q46/datafusion:vortex-file-compressed 39865380 37393728 1.07
tpcds_q47/datafusion:vortex-file-compressed 151456615 149679825 1.01
tpcds_q48/datafusion:vortex-file-compressed 41266628 39909163 1.03
tpcds_q49/datafusion:vortex-file-compressed 64345191 59998461 1.07
tpcds_q50/datafusion:vortex-file-compressed 43304048 40617261 1.07
tpcds_q51/datafusion:vortex-file-compressed 94272823 97569098 0.97
tpcds_q52/datafusion:vortex-file-compressed 15656432 14560755 1.08
tpcds_q53/datafusion:vortex-file-compressed 23326956 23304342 1.00
tpcds_q54/datafusion:vortex-file-compressed 🚨 41198608 36234621 1.14
tpcds_q55/datafusion:vortex-file-compressed 15661175 15482290 1.01
tpcds_q56/datafusion:vortex-file-compressed 33195903 30828423 1.08
tpcds_q57/datafusion:vortex-file-compressed 96058451 96221689 1.00
tpcds_q58/datafusion:vortex-file-compressed 60384351 57052566 1.06
tpcds_q59/datafusion:vortex-file-compressed 66446394 62139127 1.07
tpcds_q60/datafusion:vortex-file-compressed 32943375 32580812 1.01
tpcds_q61/datafusion:vortex-file-compressed 44472371 41768557 1.06
tpcds_q62/datafusion:vortex-file-compressed 24685043 23034210 1.07
tpcds_q63/datafusion:vortex-file-compressed 23901056 24322077 0.98
tpcds_q64/datafusion:vortex-file-compressed 428351584 424939013 1.01
tpcds_q65/datafusion:vortex-file-compressed 56574071 56983395 0.99
tpcds_q66/datafusion:vortex-file-compressed 73873696 73345129 1.01
tpcds_q67/datafusion:vortex-file-compressed 162735573 170553194 0.95
tpcds_q68/datafusion:vortex-file-compressed 37714664 35033629 1.08
tpcds_q69/datafusion:vortex-file-compressed 39619800 37005660 1.07
tpcds_q70/datafusion:vortex-file-compressed 102306935 102291663 1.00
tpcds_q71/datafusion:vortex-file-compressed 25425486 24140006 1.05
tpcds_q72/datafusion:vortex-file-compressed 2323917264 2254635617 1.03
tpcds_q73/datafusion:vortex-file-compressed 27508764 25457179 1.08
tpcds_q74/datafusion:vortex-file-compressed 90082064 83094360 1.08
tpcds_q75/datafusion:vortex-file-compressed 115433691 112047860 1.03
tpcds_q76/datafusion:vortex-file-compressed 30737078 28508398 1.08
tpcds_q77/datafusion:vortex-file-compressed 39078187 39063245 1.00
tpcds_q78/datafusion:vortex-file-compressed 123414080 116347964 1.06
tpcds_q79/datafusion:vortex-file-compressed 32245232 32319319 1.00
tpcds_q80/datafusion:vortex-file-compressed 101325978 95580692 1.06
tpcds_q81/datafusion:vortex-file-compressed 25994102 25522018 1.02
tpcds_q82/datafusion:vortex-file-compressed 24399573 25077758 0.97
tpcds_q83/datafusion:vortex-file-compressed 36841065 36004642 1.02
tpcds_q84/datafusion:vortex-file-compressed 12964979 13201783 0.98
tpcds_q85/datafusion:vortex-file-compressed 97326245 93144566 1.04
tpcds_q86/datafusion:vortex-file-compressed 17046006 15758564 1.08
tpcds_q87/datafusion:vortex-file-compressed 43447551 43582776 1.00
tpcds_q88/datafusion:vortex-file-compressed 59540276 57136839 1.04
tpcds_q89/datafusion:vortex-file-compressed 29524321 28320231 1.04
tpcds_q90/datafusion:vortex-file-compressed 15042300 13968858 1.08
tpcds_q91/datafusion:vortex-file-compressed 21016711 19527950 1.08
tpcds_q92/datafusion:vortex-file-compressed 18040275 17495039 1.03
tpcds_q93/datafusion:vortex-file-compressed 37204592 33844477 1.10
tpcds_q94/datafusion:vortex-file-compressed 23008200 22218840 1.04
tpcds_q95/datafusion:vortex-file-compressed 61164755 57494465 1.06
tpcds_q96/datafusion:vortex-file-compressed 14732612 14184124 1.04
tpcds_q97/datafusion:vortex-file-compressed 31615233 30738576 1.03
tpcds_q98/datafusion:vortex-file-compressed 27699191 27657764 1.00
tpcds_q99/datafusion:vortex-file-compressed 25975380 28152305 0.92
datafusion / vortex-compact (1.030x ➖, 1↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24972661 24669902 1.01
tpcds_q02/datafusion:vortex-compact 54383228 53623720 1.01
tpcds_q03/datafusion:vortex-compact 21346932 20893746 1.02
tpcds_q04/datafusion:vortex-compact 296569550 283881261 1.04
tpcds_q05/datafusion:vortex-compact 51694904 50462750 1.02
tpcds_q06/datafusion:vortex-compact 31682234 29833632 1.06
tpcds_q07/datafusion:vortex-compact 65866199 63343802 1.04
tpcds_q08/datafusion:vortex-compact 43279666 41503503 1.04
tpcds_q09/datafusion:vortex-compact 61345187 56469402 1.09
tpcds_q10/datafusion:vortex-compact 59481087 56155045 1.06
tpcds_q11/datafusion:vortex-compact 164862363 161301363 1.02
tpcds_q12/datafusion:vortex-compact 22693088 22572936 1.01
tpcds_q13/datafusion:vortex-compact 139835451 133982975 1.04
tpcds_q14/datafusion:vortex-compact 205295053 196823141 1.04
tpcds_q15/datafusion:vortex-compact 32569398 32161433 1.01
tpcds_q16/datafusion:vortex-compact 31584448 31220302 1.01
tpcds_q17/datafusion:vortex-compact 111140765 104065952 1.07
tpcds_q18/datafusion:vortex-compact 76945909 75989627 1.01
tpcds_q19/datafusion:vortex-compact 36672259 34554101 1.06
tpcds_q20/datafusion:vortex-compact 26384561 24037727 1.10
tpcds_q21/datafusion:vortex-compact 45439062 42470901 1.07
tpcds_q22/datafusion:vortex-compact 🚀 148042581 168620323 0.88
tpcds_q23/datafusion:vortex-compact 198566936 189778058 1.05
tpcds_q24/datafusion:vortex-compact 115606701 113723737 1.02
tpcds_q25/datafusion:vortex-compact 87230762 83434804 1.05
tpcds_q26/datafusion:vortex-compact 46565471 46521748 1.00
tpcds_q27/datafusion:vortex-compact 147825900 143460860 1.03
tpcds_q28/datafusion:vortex-compact 92623698 89526255 1.03
tpcds_q29/datafusion:vortex-compact 84908032 82976729 1.02
tpcds_q30/datafusion:vortex-compact 30811367 30945353 1.00
tpcds_q31/datafusion:vortex-compact 110517579 108853950 1.02
tpcds_q32/datafusion:vortex-compact 24205931 23646530 1.02
tpcds_q33/datafusion:vortex-compact 41398662 41489370 1.00
tpcds_q34/datafusion:vortex-compact 46591290 46541920 1.00
tpcds_q35/datafusion:vortex-compact 64463792 61743817 1.04
tpcds_q36/datafusion:vortex-compact 81294046 79412153 1.02
tpcds_q37/datafusion:vortex-compact 29769298 29600071 1.01
tpcds_q38/datafusion:vortex-compact 56504189 55546219 1.02
tpcds_q39/datafusion:vortex-compact 126861065 117911760 1.08
tpcds_q40/datafusion:vortex-compact 34550511 34519744 1.00
tpcds_q41/datafusion:vortex-compact 25580411 23989827 1.07
tpcds_q42/datafusion:vortex-compact 20227431 19483217 1.04
tpcds_q43/datafusion:vortex-compact 29247899 27686128 1.06
tpcds_q44/datafusion:vortex-compact 50512444 49887789 1.01
tpcds_q45/datafusion:vortex-compact 32337111 30717432 1.05
tpcds_q46/datafusion:vortex-compact 61295849 58272477 1.05
tpcds_q47/datafusion:vortex-compact 172633514 172223042 1.00
tpcds_q48/datafusion:vortex-compact 107137964 102693610 1.04
tpcds_q49/datafusion:vortex-compact 79927870 80202629 1.00
tpcds_q50/datafusion:vortex-compact 57941821 56782324 1.02
tpcds_q51/datafusion:vortex-compact 102023553 97651107 1.04
tpcds_q52/datafusion:vortex-compact 20629176 19928204 1.04
tpcds_q53/datafusion:vortex-compact 31926774 31199856 1.02
tpcds_q54/datafusion:vortex-compact 47504189 46236712 1.03
tpcds_q55/datafusion:vortex-compact 20036742 20163641 0.99
tpcds_q56/datafusion:vortex-compact 43764072 41239080 1.06
tpcds_q57/datafusion:vortex-compact 107869634 103244096 1.04
tpcds_q58/datafusion:vortex-compact 68704598 63053739 1.09
tpcds_q59/datafusion:vortex-compact 82057156 80591679 1.02
tpcds_q60/datafusion:vortex-compact 43034416 41664377 1.03
tpcds_q61/datafusion:vortex-compact 64108391 58708422 1.09
tpcds_q62/datafusion:vortex-compact 🚨 27323783 23768337 1.15
tpcds_q63/datafusion:vortex-compact 32858313 31086626 1.06
tpcds_q64/datafusion:vortex-compact 489241039 477800778 1.02
tpcds_q65/datafusion:vortex-compact 70378649 69891038 1.01
tpcds_q66/datafusion:vortex-compact 77533856 76344256 1.02
tpcds_q67/datafusion:vortex-compact 179169268 166759498 1.07
tpcds_q68/datafusion:vortex-compact 58770706 55675573 1.06
tpcds_q69/datafusion:vortex-compact 56150988 53671743 1.05
tpcds_q70/datafusion:vortex-compact 120741513 120420536 1.00
tpcds_q71/datafusion:vortex-compact 35624247 34605072 1.03
tpcds_q72/datafusion:vortex-compact 2326239592 2285775556 1.02
tpcds_q73/datafusion:vortex-compact 41299922 40037195 1.03
tpcds_q74/datafusion:vortex-compact 100947972 100844561 1.00
tpcds_q75/datafusion:vortex-compact 143562843 139010802 1.03
tpcds_q76/datafusion:vortex-compact 39459305 40227674 0.98
tpcds_q77/datafusion:vortex-compact 51797933 49427210 1.05
tpcds_q78/datafusion:vortex-compact 141512930 136005380 1.04
tpcds_q79/datafusion:vortex-compact 52421784 49654730 1.06
tpcds_q80/datafusion:vortex-compact 109739192 105962315 1.04
tpcds_q81/datafusion:vortex-compact 28927012 29391961 0.98
tpcds_q82/datafusion:vortex-compact 32456248 30607471 1.06
tpcds_q83/datafusion:vortex-compact 39569059 38593816 1.03
tpcds_q84/datafusion:vortex-compact 15858661 14664132 1.08
tpcds_q85/datafusion:vortex-compact 150151194 143071463 1.05
tpcds_q86/datafusion:vortex-compact 18597987 18064274 1.03
tpcds_q87/datafusion:vortex-compact 53416359 54405710 0.98
tpcds_q88/datafusion:vortex-compact 114782895 113827478 1.01
tpcds_q89/datafusion:vortex-compact 36614505 36362453 1.01
tpcds_q90/datafusion:vortex-compact 17573640 16520057 1.06
tpcds_q91/datafusion:vortex-compact 40321879 37890760 1.06
tpcds_q92/datafusion:vortex-compact 20776524 20640035 1.01
tpcds_q93/datafusion:vortex-compact 45089769 42878654 1.05
tpcds_q94/datafusion:vortex-compact 27895359 27157319 1.03
tpcds_q95/datafusion:vortex-compact 65913961 65566132 1.01
tpcds_q96/datafusion:vortex-compact 22837873 23307086 0.98
tpcds_q97/datafusion:vortex-compact 39704628 38420050 1.03
tpcds_q98/datafusion:vortex-compact 32906897 32735090 1.01
tpcds_q99/datafusion:vortex-compact 29238096 30407987 0.96
datafusion / parquet (1.025x ➖, 0↑ 4↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 24935675 26544178 0.94
tpcds_q02/datafusion:parquet 45548343 42259473 1.08
tpcds_q03/datafusion:parquet 14675853 14211167 1.03
tpcds_q04/datafusion:parquet 321950882 318627886 1.01
tpcds_q05/datafusion:parquet 49274620 48245266 1.02
tpcds_q06/datafusion:parquet 24249237 23501278 1.03
tpcds_q07/datafusion:parquet 85959585 82621954 1.04
tpcds_q08/datafusion:parquet 32341733 29844065 1.08
tpcds_q09/datafusion:parquet 43713902 40678725 1.07
tpcds_q10/datafusion:parquet 83187262 75724514 1.10
tpcds_q11/datafusion:parquet 166907397 156421309 1.07
tpcds_q12/datafusion:parquet 20057935 19145199 1.05
tpcds_q13/datafusion:parquet 80470653 78445573 1.03
tpcds_q14/datafusion:parquet 169878460 170352943 1.00
tpcds_q15/datafusion:parquet 22666880 22441856 1.01
tpcds_q16/datafusion:parquet 30333895 30595994 0.99
tpcds_q17/datafusion:parquet 65868528 69465236 0.95
tpcds_q18/datafusion:parquet 115167303 108975735 1.06
tpcds_q19/datafusion:parquet 25312478 25553867 0.99
tpcds_q20/datafusion:parquet 20200586 18564748 1.09
tpcds_q21/datafusion:parquet 20901418 20721459 1.01
tpcds_q22/datafusion:parquet 🚨 178895367 158184332 1.13
tpcds_q23/datafusion:parquet 168590500 157764139 1.07
tpcds_q24/datafusion:parquet 98103108 97837418 1.00
tpcds_q25/datafusion:parquet 66675374 65637587 1.02
tpcds_q26/datafusion:parquet 72320744 71809488 1.01
tpcds_q27/datafusion:parquet 154772187 152118375 1.02
tpcds_q28/datafusion:parquet 49992944 48291210 1.04
tpcds_q29/datafusion:parquet 70803808 68922811 1.03
tpcds_q30/datafusion:parquet 35820025 34011390 1.05
tpcds_q31/datafusion:parquet 71011403 69019526 1.03
tpcds_q32/datafusion:parquet 18959387 17935439 1.06
tpcds_q33/datafusion:parquet 29460538 29628182 0.99
tpcds_q34/datafusion:parquet 23391982 25505988 0.92
tpcds_q35/datafusion:parquet 78898119 80304177 0.98
tpcds_q36/datafusion:parquet 64426687 63919239 1.01
tpcds_q37/datafusion:parquet 21037745 21075391 1.00
tpcds_q38/datafusion:parquet 45586976 46386334 0.98
tpcds_q39/datafusion:parquet 82937336 81622925 1.02
tpcds_q40/datafusion:parquet 25380834 24704956 1.03
tpcds_q41/datafusion:parquet 16301858 15866549 1.03
tpcds_q42/datafusion:parquet 12825097 12438859 1.03
tpcds_q43/datafusion:parquet 18552761 18540924 1.00
tpcds_q44/datafusion:parquet 36642626 35165139 1.04
tpcds_q45/datafusion:parquet 31260597 29694449 1.05
tpcds_q46/datafusion:parquet 36348023 34167787 1.06
tpcds_q47/datafusion:parquet 140613368 139103720 1.01
tpcds_q48/datafusion:parquet 74249602 72475408 1.02
tpcds_q49/datafusion:parquet 59671406 58851067 1.01
tpcds_q50/datafusion:parquet 46498208 44037896 1.06
tpcds_q51/datafusion:parquet 92117747 90831695 1.01
tpcds_q52/datafusion:parquet 🚨 14906102 13350648 1.12
tpcds_q53/datafusion:parquet 19223424 18905981 1.02
tpcds_q54/datafusion:parquet 36469021 36697139 0.99
tpcds_q55/datafusion:parquet 12382388 12401689 1.00
tpcds_q56/datafusion:parquet 30962663 31109766 1.00
tpcds_q57/datafusion:parquet 110271856 112965874 0.98
tpcds_q58/datafusion:parquet 60936551 59508379 1.02
tpcds_q59/datafusion:parquet 66630993 65890526 1.01
tpcds_q60/datafusion:parquet 30286647 28457463 1.06
tpcds_q61/datafusion:parquet 45536606 45993051 0.99
tpcds_q62/datafusion:parquet 🚨 26587646 21917397 1.21
tpcds_q63/datafusion:parquet 19138658 19141096 1.00
tpcds_q64/datafusion:parquet 332118250 311323785 1.07
tpcds_q65/datafusion:parquet 40893876 39462498 1.04
tpcds_q66/datafusion:parquet 70786778 70932315 1.00
tpcds_q67/datafusion:parquet 165593111 156481808 1.06
tpcds_q68/datafusion:parquet 36439649 33639613 1.08
tpcds_q69/datafusion:parquet 71876723 69872992 1.03
tpcds_q70/datafusion:parquet 37404562 37269372 1.00
tpcds_q71/datafusion:parquet 25754768 24180748 1.07
tpcds_q72/datafusion:parquet 639919407 636727815 1.01
tpcds_q73/datafusion:parquet 22613971 23068768 0.98
tpcds_q74/datafusion:parquet 86205085 89022921 0.97
tpcds_q75/datafusion:parquet 110955580 110006065 1.01
tpcds_q76/datafusion:parquet 33967940 32519909 1.04
tpcds_q77/datafusion:parquet 40934255 40736814 1.00
tpcds_q78/datafusion:parquet 121521825 119340666 1.02
tpcds_q79/datafusion:parquet 29173471 27457493 1.06
tpcds_q80/datafusion:parquet 80713836 82923209 0.97
tpcds_q81/datafusion:parquet 31554201 31246373 1.01
tpcds_q82/datafusion:parquet 20567711 20441805 1.01
tpcds_q83/datafusion:parquet 44318721 42449831 1.04
tpcds_q84/datafusion:parquet 43195214 41511927 1.04
tpcds_q85/datafusion:parquet 152943859 153779620 0.99
tpcds_q86/datafusion:parquet 🚨 17577691 14512960 1.21
tpcds_q87/datafusion:parquet 47383699 46246376 1.02
tpcds_q88/datafusion:parquet 65506326 62712781 1.04
tpcds_q89/datafusion:parquet 23318748 22837012 1.02
tpcds_q90/datafusion:parquet 15951127 15261251 1.05
tpcds_q91/datafusion:parquet 63312396 62298208 1.02
tpcds_q92/datafusion:parquet 19113034 18989033 1.01
tpcds_q93/datafusion:parquet 32200035 33818732 0.95
tpcds_q94/datafusion:parquet 21873825 22899211 0.96
tpcds_q95/datafusion:parquet 63034366 62959108 1.00
tpcds_q96/datafusion:parquet 13425144 13516187 0.99
tpcds_q97/datafusion:parquet 31867444 33058516 0.96
tpcds_q98/datafusion:parquet 22581028 22522369 1.00
tpcds_q99/datafusion:parquet 30426331 27673298 1.10
duckdb / vortex-file-compressed (1.048x ➖, 0↑ 14↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23673885 24073050 0.98
tpcds_q02/duckdb:vortex-file-compressed 24147497 24397908 0.99
tpcds_q03/duckdb:vortex-file-compressed 21055255 20747928 1.01
tpcds_q04/duckdb:vortex-file-compressed 105845630 99608061 1.06
tpcds_q05/duckdb:vortex-file-compressed 36296260 36036101 1.01
tpcds_q06/duckdb:vortex-file-compressed 38253326 35993360 1.06
tpcds_q07/duckdb:vortex-file-compressed 30643311 30009818 1.02
tpcds_q08/duckdb:vortex-file-compressed 32445527 30464109 1.07
tpcds_q09/duckdb:vortex-file-compressed 17100197 16536317 1.03
tpcds_q10/duckdb:vortex-file-compressed 44521487 42805803 1.04
tpcds_q11/duckdb:vortex-file-compressed 80822009 76261711 1.06
tpcds_q12/duckdb:vortex-file-compressed 15961055 14934537 1.07
tpcds_q13/duckdb:vortex-file-compressed 38159879 36291240 1.05
tpcds_q14/duckdb:vortex-file-compressed 109556308 108331456 1.01
tpcds_q15/duckdb:vortex-file-compressed 29831581 29235497 1.02
tpcds_q16/duckdb:vortex-file-compressed 25638156 26298358 0.97
tpcds_q17/duckdb:vortex-file-compressed 51304128 49876092 1.03
tpcds_q18/duckdb:vortex-file-compressed 42932251 44770328 0.96
tpcds_q19/duckdb:vortex-file-compressed 37310656 37775832 0.99
tpcds_q20/duckdb:vortex-file-compressed 16986346 15711084 1.08
tpcds_q21/duckdb:vortex-file-compressed 17160349 17148074 1.00
tpcds_q22/duckdb:vortex-file-compressed 80837648 75106229 1.08
tpcds_q23/duckdb:vortex-file-compressed 93231108 93073131 1.00
tpcds_q24/duckdb:vortex-file-compressed 49682569 48071835 1.03
tpcds_q25/duckdb:vortex-file-compressed 39741819 38083488 1.04
tpcds_q26/duckdb:vortex-file-compressed 20011473 20024005 1.00
tpcds_q27/duckdb:vortex-file-compressed 30836255 30509416 1.01
tpcds_q28/duckdb:vortex-file-compressed 12895652 12469583 1.03
tpcds_q29/duckdb:vortex-file-compressed 48831658 49157010 0.99
tpcds_q30/duckdb:vortex-file-compressed 27944133 26324067 1.06
tpcds_q31/duckdb:vortex-file-compressed 32480649 32065621 1.01
tpcds_q32/duckdb:vortex-file-compressed 15617341 14497165 1.08
tpcds_q33/duckdb:vortex-file-compressed 29134981 27888302 1.04
tpcds_q34/duckdb:vortex-file-compressed 29035434 29743037 0.98
tpcds_q35/duckdb:vortex-file-compressed 74689311 70475204 1.06
tpcds_q36/duckdb:vortex-file-compressed 27807448 26875568 1.03
tpcds_q37/duckdb:vortex-file-compressed 21785162 20413703 1.07
tpcds_q38/duckdb:vortex-file-compressed 43829652 41842090 1.05
tpcds_q39/duckdb:vortex-file-compressed 🚨 33561633 29269754 1.15
tpcds_q40/duckdb:vortex-file-compressed 20883610 20280440 1.03
tpcds_q41/duckdb:vortex-file-compressed 🚨 14747745 12811630 1.15
tpcds_q42/duckdb:vortex-file-compressed 17033848 16505164 1.03
tpcds_q43/duckdb:vortex-file-compressed 20196328 18967135 1.06
tpcds_q44/duckdb:vortex-file-compressed 24145034 22612935 1.07
tpcds_q45/duckdb:vortex-file-compressed 33251440 32252785 1.03
tpcds_q46/duckdb:vortex-file-compressed 🚨 39970676 33033786 1.21
tpcds_q47/duckdb:vortex-file-compressed 56111357 56830130 0.99
tpcds_q48/duckdb:vortex-file-compressed 34880702 33650363 1.04
tpcds_q49/duckdb:vortex-file-compressed 36312061 37478931 0.97
tpcds_q50/duckdb:vortex-file-compressed 28943898 29233238 0.99
tpcds_q51/duckdb:vortex-file-compressed 111533540 106635812 1.05
tpcds_q52/duckdb:vortex-file-compressed 16201163 16731153 0.97
tpcds_q53/duckdb:vortex-file-compressed 26701683 25576320 1.04
tpcds_q54/duckdb:vortex-file-compressed 🚨 34986017 31259144 1.12
tpcds_q55/duckdb:vortex-file-compressed 16825592 15388522 1.09
tpcds_q56/duckdb:vortex-file-compressed 30092872 29822944 1.01
tpcds_q57/duckdb:vortex-file-compressed 39483279 38395534 1.03
tpcds_q58/duckdb:vortex-file-compressed 33033614 32523121 1.02
tpcds_q59/duckdb:vortex-file-compressed 40282504 39628517 1.02
tpcds_q60/duckdb:vortex-file-compressed 29728109 29232418 1.02
tpcds_q61/duckdb:vortex-file-compressed 35355251 34419262 1.03
tpcds_q62/duckdb:vortex-file-compressed 16988918 16013037 1.06
tpcds_q63/duckdb:vortex-file-compressed 25217662 23189651 1.09
tpcds_q64/duckdb:vortex-file-compressed 110186792 105262985 1.05
tpcds_q65/duckdb:vortex-file-compressed 🚨 27082092 23983847 1.13
tpcds_q66/duckdb:vortex-file-compressed 31704078 29980176 1.06
tpcds_q67/duckdb:vortex-file-compressed 151543467 146992795 1.03
tpcds_q68/duckdb:vortex-file-compressed 🚨 40185533 34873242 1.15
tpcds_q69/duckdb:vortex-file-compressed 🚨 50067554 45250150 1.11
tpcds_q70/duckdb:vortex-file-compressed 🚨 38902846 33729426 1.15
tpcds_q71/duckdb:vortex-file-compressed 25823704 23803114 1.08
tpcds_q72/duckdb:vortex-file-compressed 169569928 156299829 1.08
tpcds_q73/duckdb:vortex-file-compressed 32203852 29675330 1.09
tpcds_q74/duckdb:vortex-file-compressed 49428577 48652943 1.02
tpcds_q75/duckdb:vortex-file-compressed 53556904 52395449 1.02
tpcds_q76/duckdb:vortex-file-compressed 23413016 22750659 1.03
tpcds_q77/duckdb:vortex-file-compressed 26523873 26319256 1.01
tpcds_q78/duckdb:vortex-file-compressed 73239247 69019194 1.06
tpcds_q79/duckdb:vortex-file-compressed 30213675 28742113 1.05
tpcds_q80/duckdb:vortex-file-compressed 53602051 51352373 1.04
tpcds_q81/duckdb:vortex-file-compressed 🚨 35030303 31781494 1.10
tpcds_q82/duckdb:vortex-file-compressed 49609127 48115956 1.03
tpcds_q83/duckdb:vortex-file-compressed 30422609 30276408 1.00
tpcds_q84/duckdb:vortex-file-compressed 🚨 20545723 18577432 1.11
tpcds_q85/duckdb:vortex-file-compressed 🚨 50559192 45008640 1.12
tpcds_q86/duckdb:vortex-file-compressed 18282923 17749049 1.03
tpcds_q87/duckdb:vortex-file-compressed 🚨 44675795 40237991 1.11
tpcds_q88/duckdb:vortex-file-compressed 64694125 62413326 1.04
tpcds_q89/duckdb:vortex-file-compressed 25669927 24467959 1.05
tpcds_q90/duckdb:vortex-file-compressed 12743995 12279946 1.04
tpcds_q91/duckdb:vortex-file-compressed 26256138 24005215 1.09
tpcds_q92/duckdb:vortex-file-compressed 21055531 19759532 1.07
tpcds_q93/duckdb:vortex-file-compressed 30962919 30450408 1.02
tpcds_q94/duckdb:vortex-file-compressed 26197509 23961174 1.09
tpcds_q95/duckdb:vortex-file-compressed 130169787 128832264 1.01
tpcds_q96/duckdb:vortex-file-compressed 15412693 14187620 1.09
tpcds_q97/duckdb:vortex-file-compressed 39841995 39794568 1.00
tpcds_q98/duckdb:vortex-file-compressed 🚨 23326698 20379031 1.14
tpcds_q99/duckdb:vortex-file-compressed 🚨 22730903 19617171 1.16
duckdb / vortex-compact (1.031x ➖, 0↑ 5↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25745962 27201743 0.95
tpcds_q02/duckdb:vortex-compact 26299218 26666931 0.99
tpcds_q03/duckdb:vortex-compact 47854999 46693034 1.02
tpcds_q04/duckdb:vortex-compact 118192361 124035724 0.95
tpcds_q05/duckdb:vortex-compact 58385497 53391934 1.09
tpcds_q06/duckdb:vortex-compact 52336805 51662535 1.01
tpcds_q07/duckdb:vortex-compact 62888773 61964216 1.01
tpcds_q08/duckdb:vortex-compact 110206211 105533827 1.04
tpcds_q09/duckdb:vortex-compact 27749369 26547413 1.05
tpcds_q10/duckdb:vortex-compact 84901525 82449827 1.03
tpcds_q11/duckdb:vortex-compact 92468739 91883683 1.01
tpcds_q12/duckdb:vortex-compact 21546714 21048076 1.02
tpcds_q13/duckdb:vortex-compact 89283145 88949717 1.00
tpcds_q14/duckdb:vortex-compact 148916356 147953115 1.01
tpcds_q15/duckdb:vortex-compact 35909656 36202847 0.99
tpcds_q16/duckdb:vortex-compact 🚨 35817878 32168406 1.11
tpcds_q17/duckdb:vortex-compact 94947635 92399807 1.03
tpcds_q18/duckdb:vortex-compact 🚨 64230868 56086439 1.15
tpcds_q19/duckdb:vortex-compact 70141620 70757340 0.99
tpcds_q20/duckdb:vortex-compact 20839693 19766470 1.05
tpcds_q21/duckdb:vortex-compact 19945885 18549149 1.08
tpcds_q22/duckdb:vortex-compact 80898074 77543976 1.04
tpcds_q23/duckdb:vortex-compact 🚨 142201071 128696229 1.10
tpcds_q24/duckdb:vortex-compact 79012252 76252907 1.04
tpcds_q25/duckdb:vortex-compact 67143671 63936025 1.05
tpcds_q26/duckdb:vortex-compact 39991256 39335172 1.02
tpcds_q27/duckdb:vortex-compact 71291933 70567430 1.01
tpcds_q28/duckdb:vortex-compact 24001837 22765335 1.05
tpcds_q29/duckdb:vortex-compact 90932648 91406899 0.99
tpcds_q30/duckdb:vortex-compact 34528931 31974167 1.08
tpcds_q31/duckdb:vortex-compact 52168465 53051632 0.98
tpcds_q32/duckdb:vortex-compact 21191360 20215728 1.05
tpcds_q33/duckdb:vortex-compact 49093094 48593908 1.01
tpcds_q34/duckdb:vortex-compact 57924535 56137604 1.03
tpcds_q35/duckdb:vortex-compact 107239529 105185958 1.02
tpcds_q36/duckdb:vortex-compact 49982412 48569720 1.03
tpcds_q37/duckdb:vortex-compact 24818499 23524391 1.06
tpcds_q38/duckdb:vortex-compact 59823076 56017320 1.07
tpcds_q39/duckdb:vortex-compact 🚨 35559089 30299664 1.17
tpcds_q40/duckdb:vortex-compact 25201166 24591730 1.02
tpcds_q41/duckdb:vortex-compact 🚨 16675480 14663273 1.14
tpcds_q42/duckdb:vortex-compact 27338886 27097683 1.01
tpcds_q43/duckdb:vortex-compact 40328236 39928571 1.01
tpcds_q44/duckdb:vortex-compact 38161242 37248021 1.02
tpcds_q45/duckdb:vortex-compact 42667986 41291819 1.03
tpcds_q46/duckdb:vortex-compact 76870266 75056683 1.02
tpcds_q47/duckdb:vortex-compact 78286146 76692299 1.02
tpcds_q48/duckdb:vortex-compact 77570780 77147049 1.01
tpcds_q49/duckdb:vortex-compact 64318822 63147906 1.02
tpcds_q50/duckdb:vortex-compact 60686180 60289861 1.01
tpcds_q51/duckdb:vortex-compact 121443154 115683230 1.05
tpcds_q52/duckdb:vortex-compact 27142010 25544226 1.06
tpcds_q53/duckdb:vortex-compact 47260121 46541717 1.02
tpcds_q54/duckdb:vortex-compact 52257135 49754553 1.05
tpcds_q55/duckdb:vortex-compact 26384050 25351700 1.04
tpcds_q56/duckdb:vortex-compact 49438248 47399227 1.04
tpcds_q57/duckdb:vortex-compact 42668032 43191890 0.99
tpcds_q58/duckdb:vortex-compact 46366490 44490441 1.04
tpcds_q59/duckdb:vortex-compact 59291123 57873814 1.02
tpcds_q60/duckdb:vortex-compact 52031771 50137894 1.04
tpcds_q61/duckdb:vortex-compact 95366816 92441040 1.03
tpcds_q62/duckdb:vortex-compact 19531281 19323311 1.01
tpcds_q63/duckdb:vortex-compact 45246942 45393594 1.00
tpcds_q64/duckdb:vortex-compact 173731094 174273254 1.00
tpcds_q65/duckdb:vortex-compact 43383408 41655250 1.04
tpcds_q66/duckdb:vortex-compact 41722382 41649744 1.00
tpcds_q67/duckdb:vortex-compact 173676648 172621131 1.01
tpcds_q68/duckdb:vortex-compact 76960644 77620052 0.99
tpcds_q69/duckdb:vortex-compact 82851757 82593317 1.00
tpcds_q70/duckdb:vortex-compact 74999077 73626689 1.02
tpcds_q71/duckdb:vortex-compact 46773075 45173538 1.04
tpcds_q72/duckdb:vortex-compact 186067416 179884831 1.03
tpcds_q73/duckdb:vortex-compact 55298685 53811587 1.03
tpcds_q74/duckdb:vortex-compact 65545660 61665224 1.06
tpcds_q75/duckdb:vortex-compact 69945132 70637391 0.99
tpcds_q76/duckdb:vortex-compact 38118707 37466409 1.02
tpcds_q77/duckdb:vortex-compact 49465764 48407416 1.02
tpcds_q78/duckdb:vortex-compact 89284338 86145452 1.04
tpcds_q79/duckdb:vortex-compact 93097889 92576379 1.01
tpcds_q80/duckdb:vortex-compact 83473971 82533624 1.01
tpcds_q81/duckdb:vortex-compact 36479584 33682442 1.08
tpcds_q82/duckdb:vortex-compact 52807957 52851232 1.00
tpcds_q83/duckdb:vortex-compact 39171007 38166533 1.03
tpcds_q84/duckdb:vortex-compact 23178838 21733711 1.07
tpcds_q85/duckdb:vortex-compact 68893621 67218440 1.02
tpcds_q86/duckdb:vortex-compact 21198850 20210792 1.05
tpcds_q87/duckdb:vortex-compact 61839459 61021026 1.01
tpcds_q88/duckdb:vortex-compact 244511996 236771434 1.03
tpcds_q89/duckdb:vortex-compact 48134008 45612369 1.06
tpcds_q90/duckdb:vortex-compact 18990095 17380194 1.09
tpcds_q91/duckdb:vortex-compact 58949188 56859954 1.04
tpcds_q92/duckdb:vortex-compact 37233479 35501123 1.05
tpcds_q93/duckdb:vortex-compact 41015542 39452261 1.04
tpcds_q94/duckdb:vortex-compact 34535512 32867541 1.05
tpcds_q95/duckdb:vortex-compact 142419295 139484750 1.02
tpcds_q96/duckdb:vortex-compact 40075669 37539275 1.07
tpcds_q97/duckdb:vortex-compact 49375753 52369115 0.94
tpcds_q98/duckdb:vortex-compact 34938168 33880374 1.03
tpcds_q99/duckdb:vortex-compact 24907342 24491861 1.02
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31057502 31121687 1.00
tpcds_q02/duckdb:parquet 25379623 25039791 1.01
tpcds_q03/duckdb:parquet 14105440 13023110 1.08
tpcds_q04/duckdb:parquet 175602301 174343234 1.01
tpcds_q05/duckdb:parquet 33290358 33229539 1.00
tpcds_q06/duckdb:parquet 34728093 35420692 0.98
tpcds_q07/duckdb:parquet 25651492 25430698 1.01
tpcds_q08/duckdb:parquet 31828321 30924382 1.03
tpcds_q09/duckdb:parquet 46245393 47198424 0.98
tpcds_q10/duckdb:parquet 39646799 39712571 1.00
tpcds_q11/duckdb:parquet 94248452 96384773 0.98
tpcds_q12/duckdb:parquet 17032208 16528103 1.03
tpcds_q13/duckdb:parquet 36272987 36770626 0.99
tpcds_q14/duckdb:parquet 109974610 106608023 1.03
tpcds_q15/duckdb:parquet 33230604 32318678 1.03
tpcds_q16/duckdb:parquet 24447639 23770961 1.03
tpcds_q17/duckdb:parquet 42512880 42323034 1.00
tpcds_q18/duckdb:parquet 51055269 50530221 1.01
tpcds_q19/duckdb:parquet 34844113 33137063 1.05
tpcds_q20/duckdb:parquet 17982022 17626116 1.02
tpcds_q21/duckdb:parquet 12356107 12328280 1.00
tpcds_q22/duckdb:parquet 72540895 75585970 0.96
tpcds_q23/duckdb:parquet 84448565 83035502 1.02
tpcds_q24/duckdb:parquet 49766911 49891326 1.00
tpcds_q25/duckdb:parquet 37903595 37110604 1.02
tpcds_q26/duckdb:parquet 41646741 41132362 1.01
tpcds_q27/duckdb:parquet 56411985 55231072 1.02
tpcds_q28/duckdb:parquet 44487640 43898835 1.01
tpcds_q29/duckdb:parquet 42006743 39838709 1.05
tpcds_q30/duckdb:parquet 39500237 38873593 1.02
tpcds_q31/duckdb:parquet 29313472 28803025 1.02
tpcds_q32/duckdb:parquet 13584808 14217363 0.96
tpcds_q33/duckdb:parquet 24527143 24809539 0.99
tpcds_q34/duckdb:parquet 23935456 24409306 0.98
tpcds_q35/duckdb:parquet 63878527 64901191 0.98
tpcds_q36/duckdb:parquet 23606629 23847411 0.99
tpcds_q37/duckdb:parquet 16324552 14869470 1.10
tpcds_q38/duckdb:parquet 38384398 38997145 0.98
tpcds_q39/duckdb:parquet 34032676 33893376 1.00
tpcds_q40/duckdb:parquet 21003862 20940390 1.00
tpcds_q41/duckdb:parquet 9652010 9377235 1.03
tpcds_q42/duckdb:parquet 13118438 13724647 0.96
tpcds_q43/duckdb:parquet 20248195 19796341 1.02
tpcds_q44/duckdb:parquet 27062432 27741677 0.98
tpcds_q45/duckdb:parquet 30742156 32267796 0.95
tpcds_q46/duckdb:parquet 50234527 49918418 1.01
tpcds_q47/duckdb:parquet 53325050 52372154 1.02
tpcds_q48/duckdb:parquet 33581720 33698759 1.00
tpcds_q49/duckdb:parquet 31150898 28829059 1.08
tpcds_q50/duckdb:parquet 27108534 27322833 0.99
tpcds_q51/duckdb:parquet 110052898 111786292 0.98
tpcds_q52/duckdb:parquet 12868837 13822932 0.93
tpcds_q53/duckdb:parquet 17964084 18269945 0.98
tpcds_q54/duckdb:parquet 29215534 29858485 0.98
tpcds_q55/duckdb:parquet 12652218 13293365 0.95
tpcds_q56/duckdb:parquet 25870270 25725735 1.01
tpcds_q57/duckdb:parquet 39803193 40944984 0.97
tpcds_q58/duckdb:parquet 27551565 26940770 1.02
tpcds_q59/duckdb:parquet 37945541 37079216 1.02
tpcds_q60/duckdb:parquet 25942558 26270260 0.99
tpcds_q61/duckdb:parquet 35864950 35454589 1.01
tpcds_q62/duckdb:parquet 13575018 13441733 1.01
tpcds_q63/duckdb:parquet 16630264 16567582 1.00
tpcds_q64/duckdb:parquet 81065020 78581423 1.03
tpcds_q65/duckdb:parquet 25179841 22999296 1.09
tpcds_q66/duckdb:parquet 31233988 31545551 0.99
tpcds_q67/duckdb:parquet 147516280 142828279 1.03
tpcds_q68/duckdb:parquet 41466883 40002900 1.04
tpcds_q69/duckdb:parquet 40963126 39852300 1.03
tpcds_q70/duckdb:parquet 23612372 22911178 1.03
tpcds_q71/duckdb:parquet 24890913 25337781 0.98
tpcds_q72/duckdb:parquet 170890236 172113646 0.99
tpcds_q73/duckdb:parquet 21457460 21556346 1.00
tpcds_q74/duckdb:parquet 133558156 132023399 1.01
tpcds_q75/duckdb:parquet 61230115 60399414 1.01
tpcds_q76/duckdb:parquet 22629966 23504596 0.96
tpcds_q77/duckdb:parquet 27094614 26240930 1.03
tpcds_q78/duckdb:parquet 80572691 80351330 1.00
tpcds_q79/duckdb:parquet 31590677 31692797 1.00
tpcds_q80/duckdb:parquet 45445433 45608025 1.00
tpcds_q81/duckdb:parquet 36521361 36283104 1.01
tpcds_q82/duckdb:parquet 18498378 18556750 1.00
tpcds_q83/duckdb:parquet 19627641 19305059 1.02
tpcds_q84/duckdb:parquet 22614494 21394402 1.06
tpcds_q85/duckdb:parquet 44474480 43478642 1.02
tpcds_q86/duckdb:parquet 14644417 14270925 1.03
tpcds_q87/duckdb:parquet 42174126 41121376 1.03
tpcds_q88/duckdb:parquet 55443282 55324089 1.00
tpcds_q89/duckdb:parquet 19664263 19705256 1.00
tpcds_q90/duckdb:parquet 9151155 9017585 1.01
tpcds_q91/duckdb:parquet 27433871 26641273 1.03
tpcds_q92/duckdb:parquet 14289642 13919613 1.03
tpcds_q93/duckdb:parquet 34370708 34206829 1.00
tpcds_q94/duckdb:parquet 19256408 19227295 1.00
tpcds_q95/duckdb:parquet 151476623 153176355 0.99
tpcds_q96/duckdb:parquet 10997598 11092907 0.99
tpcds_q97/duckdb:parquet 41102840 40632082 1.01
tpcds_q98/duckdb:parquet 23218953 23282361 1.00
tpcds_q99/duckdb:parquet 21788952 20995076 1.04
duckdb / duckdb (1.015x ➖, 0↑ 3↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 23408741 22846822 1.02
tpcds_q02/duckdb:duckdb 20298305 20370170 1.00
tpcds_q03/duckdb:duckdb 11301240 11314840 1.00
tpcds_q04/duckdb:duckdb 184512209 178495844 1.03
tpcds_q05/duckdb:duckdb 21253394 22587933 0.94
tpcds_q06/duckdb:duckdb 29108672 28883076 1.01
tpcds_q07/duckdb:duckdb 43249263 43250063 1.00
tpcds_q08/duckdb:duckdb 122712981 122418896 1.00
tpcds_q09/duckdb:duckdb 21285795 21529617 0.99
tpcds_q10/duckdb:duckdb 29359150 30087550 0.98
tpcds_q11/duckdb:duckdb 100724598 98459364 1.02
tpcds_q12/duckdb:duckdb 13806444 13331052 1.04
tpcds_q13/duckdb:duckdb 27652633 27052851 1.02
tpcds_q14/duckdb:duckdb 97691450 97954643 1.00
tpcds_q15/duckdb:duckdb 27309448 26719817 1.02
tpcds_q16/duckdb:duckdb 20997628 20389773 1.03
tpcds_q17/duckdb:duckdb 25858166 25510408 1.01
tpcds_q18/duckdb:duckdb 50658240 50798403 1.00
tpcds_q19/duckdb:duckdb 20919004 20791175 1.01
tpcds_q20/duckdb:duckdb 14772526 13823544 1.07
tpcds_q21/duckdb:duckdb 8555863 7978800 1.07
tpcds_q22/duckdb:duckdb 71862135 66373822 1.08
tpcds_q23/duckdb:duckdb 75756831 79447492 0.95
tpcds_q24/duckdb:duckdb 26690814 26353181 1.01
tpcds_q25/duckdb:duckdb 20320384 19576035 1.04
tpcds_q26/duckdb:duckdb 30027517 30796824 0.98
tpcds_q27/duckdb:duckdb 43701988 43372760 1.01
tpcds_q28/duckdb:duckdb 25836699 25634529 1.01
tpcds_q29/duckdb:duckdb 24652000 24020023 1.03
tpcds_q30/duckdb:duckdb 33057545 32001105 1.03
tpcds_q31/duckdb:duckdb 55592781 55416444 1.00
tpcds_q32/duckdb:duckdb 8721191 8938697 0.98
tpcds_q33/duckdb:duckdb 16083275 15835251 1.02
tpcds_q34/duckdb:duckdb 19508868 19100215 1.02
tpcds_q35/duckdb:duckdb 39633048 39622159 1.00
tpcds_q36/duckdb:duckdb 77453147 77037105 1.01
tpcds_q37/duckdb:duckdb 10113277 9458770 1.07
tpcds_q38/duckdb:duckdb 🚨 38577710 34911705 1.11
tpcds_q39/duckdb:duckdb 🚨 35786574 28858676 1.24
tpcds_q40/duckdb:duckdb 16202042 15571901 1.04
tpcds_q41/duckdb:duckdb 10353163 10023828 1.03
tpcds_q42/duckdb:duckdb 9527655 9006431 1.06
tpcds_q43/duckdb:duckdb 15358832 15352068 1.00
tpcds_q44/duckdb:duckdb 15702955 16402839 0.96
tpcds_q45/duckdb:duckdb 19999675 20428814 0.98
tpcds_q46/duckdb:duckdb 41902532 42301758 0.99
tpcds_q47/duckdb:duckdb 47893086 49288803 0.97
tpcds_q48/duckdb:duckdb 26210037 25502154 1.03
tpcds_q49/duckdb:duckdb 21617947 21711445 1.00
tpcds_q50/duckdb:duckdb 16930324 16807339 1.01
tpcds_q51/duckdb:duckdb 105387523 103766695 1.02
tpcds_q52/duckdb:duckdb 9650228 9746071 0.99
tpcds_q53/duckdb:duckdb 16097855 16417554 0.98
tpcds_q54/duckdb:duckdb 19992759 19821602 1.01
tpcds_q55/duckdb:duckdb 9615895 9891957 0.97
tpcds_q56/duckdb:duckdb 17192412 16848436 1.02
tpcds_q57/duckdb:duckdb 38521258 38464997 1.00
tpcds_q58/duckdb:duckdb 16927461 17325567 0.98
tpcds_q59/duckdb:duckdb 37960111 38244920 0.99
tpcds_q60/duckdb:duckdb 19296499 18614493 1.04
tpcds_q61/duckdb:duckdb 17168839 17325388 0.99
tpcds_q62/duckdb:duckdb 10640676 10542545 1.01
tpcds_q63/duckdb:duckdb 14805311 14848770 1.00
tpcds_q64/duckdb:duckdb 62107050 60592490 1.02
tpcds_q65/duckdb:duckdb 38007313 37682576 1.01
tpcds_q66/duckdb:duckdb 30255421 27876919 1.09
tpcds_q67/duckdb:duckdb 145828601 141220995 1.03
tpcds_q68/duckdb:duckdb 28655102 28408500 1.01
tpcds_q69/duckdb:duckdb 29517872 29160367 1.01
tpcds_q70/duckdb:duckdb 18278966 17125495 1.07
tpcds_q71/duckdb:duckdb 18206379 17586296 1.04
tpcds_q72/duckdb:duckdb 49007368 46675852 1.05
tpcds_q73/duckdb:duckdb 14594140 14502090 1.01
tpcds_q74/duckdb:duckdb 150525861 153169521 0.98
tpcds_q75/duckdb:duckdb 48821574 48242560 1.01
tpcds_q76/duckdb:duckdb 15616087 15904287 0.98
tpcds_q77/duckdb:duckdb 15572111 15868726 0.98
tpcds_q78/duckdb:duckdb 70693556 68643411 1.03
tpcds_q79/duckdb:duckdb 20908537 20631721 1.01
tpcds_q80/duckdb:duckdb 33710093 32929034 1.02
tpcds_q81/duckdb:duckdb 41783502 41251283 1.01
tpcds_q82/duckdb:duckdb 11382212 11442032 0.99
tpcds_q83/duckdb:duckdb 11550659 11806550 0.98
tpcds_q84/duckdb:duckdb 15708380 15649933 1.00
tpcds_q85/duckdb:duckdb 27293177 26633445 1.02
tpcds_q86/duckdb:duckdb 12750750 13005531 0.98
tpcds_q87/duckdb:duckdb 38625205 39692742 0.97
tpcds_q88/duckdb:duckdb 30238895 29823431 1.01
tpcds_q89/duckdb:duckdb 17980365 18193705 0.99
tpcds_q90/duckdb:duckdb 6847547 6623674 1.03
tpcds_q91/duckdb:duckdb 15657214 14870734 1.05
tpcds_q92/duckdb:duckdb 10613972 10616561 1.00
tpcds_q93/duckdb:duckdb 25588851 25405749 1.01
tpcds_q94/duckdb:duckdb 15695922 15777819 0.99
tpcds_q95/duckdb:duckdb 🚨 137724193 118323383 1.16
tpcds_q96/duckdb:duckdb 6294302 5997513 1.05
tpcds_q97/duckdb:duckdb 34180034 33603548 1.02
tpcds_q98/duckdb:duckdb 18688846 17733859 1.05
tpcds_q99/duckdb:duckdb 17948397 17622951 1.02

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (+1.2%, environment too noisy confidence) · DuckDB No clear signal (-7.9%, low confidence)
Vortex (geomean): 1.043x ➖
Parquet (geomean): 1.081x ➖
Shifts: Parquet (control) +8.1% · Median polish +3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.116x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 50655722 29418677 1.72
fineweb_q01/datafusion:vortex-file-compressed 528255642 478867596 1.10
fineweb_q02/datafusion:vortex-file-compressed 594661177 473514013 1.26
fineweb_q03/datafusion:vortex-file-compressed 1081852763 1104690675 0.98
fineweb_q04/datafusion:vortex-file-compressed 1160604902 1164929392 1.00
fineweb_q05/datafusion:vortex-file-compressed 1149117217 1091675193 1.05
fineweb_q06/datafusion:vortex-file-compressed 1370195019 1254852726 1.09
fineweb_q07/datafusion:vortex-file-compressed 1113870969 1141134554 0.98
fineweb_q08/datafusion:vortex-file-compressed 465311155 451629275 1.03
datafusion / vortex-compact (1.080x ➖, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 76318931 57943508 1.32
fineweb_q01/datafusion:vortex-compact 🚨 844318713 476972841 1.77
fineweb_q02/datafusion:vortex-compact 670443501 762650458 0.88
fineweb_q03/datafusion:vortex-compact 1330078415 1356622358 0.98
fineweb_q04/datafusion:vortex-compact 1623276388 1634127159 0.99
fineweb_q05/datafusion:vortex-compact 1394373593 1370575358 1.02
fineweb_q06/datafusion:vortex-compact 1253058512 1237552301 1.01
fineweb_q07/datafusion:vortex-compact 1110611023 1136060611 0.98
fineweb_q08/datafusion:vortex-compact 389397562 390852521 1.00
datafusion / parquet (1.086x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1279000629 1057966186 1.21
fineweb_q01/datafusion:parquet 1838001569 1749355024 1.05
fineweb_q02/datafusion:parquet 1765241861 1751035696 1.01
fineweb_q03/datafusion:parquet 1840252248 1628003946 1.13
fineweb_q04/datafusion:parquet 1804051190 1759622418 1.03
fineweb_q05/datafusion:parquet 1895424910 1735860102 1.09
fineweb_q06/datafusion:parquet 1828445147 1841112018 0.99
fineweb_q07/datafusion:parquet 1849577415 1767695957 1.05
fineweb_q08/datafusion:parquet 2030643336 1632936974 1.24
duckdb / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80651103 74593249 1.08
fineweb_q01/duckdb:vortex-file-compressed 571417733 543898785 1.05
fineweb_q02/duckdb:vortex-file-compressed 515888788 519831482 0.99
fineweb_q03/duckdb:vortex-file-compressed 1321436286 1368419306 0.97
fineweb_q04/duckdb:vortex-file-compressed 1452908886 1532228991 0.95
fineweb_q05/duckdb:vortex-file-compressed 1334729388 1404194992 0.95
fineweb_q06/duckdb:vortex-file-compressed 1510646522 1500649169 1.01
fineweb_q07/duckdb:vortex-file-compressed 1498084284 1309176138 1.14
fineweb_q08/duckdb:vortex-file-compressed 555653877 578923638 0.96
duckdb / vortex-compact (0.974x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 70346552 74488398 0.94
fineweb_q01/duckdb:vortex-compact 564927627 567322786 1.00
fineweb_q02/duckdb:vortex-compact 585334606 611964436 0.96
fineweb_q03/duckdb:vortex-compact 1705469979 1844245868 0.92
fineweb_q04/duckdb:vortex-compact 1890214342 1936436678 0.98
fineweb_q05/duckdb:vortex-compact 1679901030 1719553330 0.98
fineweb_q06/duckdb:vortex-compact 1647098776 1656484568 0.99
fineweb_q07/duckdb:vortex-compact 1551304072 1504927118 1.03
fineweb_q08/duckdb:vortex-compact 489337623 506057994 0.97
duckdb / parquet (1.077x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1199162881 1045191799 1.15
fineweb_q01/duckdb:parquet 1444579953 1337605920 1.08
fineweb_q02/duckdb:parquet 1363099429 1279032185 1.07
fineweb_q03/duckdb:parquet 3725420381 3553029257 1.05
fineweb_q04/duckdb:parquet 1970041315 1819520937 1.08
fineweb_q05/duckdb:parquet 2259349085 2087802377 1.08
fineweb_q06/duckdb:parquet 4305130113 4194469187 1.03
fineweb_q07/duckdb:parquet 2718744832 2486405913 1.09
fineweb_q08/duckdb:parquet 1160828533 1088291520 1.07

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13059095 12335520 1.06
statpopgen_q01/duckdb:vortex-file-compressed 26370587 26324818 1.00
statpopgen_q02/duckdb:vortex-file-compressed 515599588 524157518 0.98
statpopgen_q03/duckdb:vortex-file-compressed 1035025825 1025220466 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1042367395 1045844168 1.00
statpopgen_q05/duckdb:vortex-file-compressed 480858175 477726421 1.01
statpopgen_q06/duckdb:vortex-file-compressed 1506128012 1512069762 1.00
statpopgen_q07/duckdb:vortex-file-compressed 192882776 198465185 0.97
statpopgen_q08/duckdb:vortex-file-compressed 222776060 222470743 1.00
statpopgen_q09/duckdb:vortex-file-compressed 823506465 818524214 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2527389120 2539218255 1.00
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11916508 11743496 1.01
statpopgen_q01/duckdb:vortex-compact 217102583 216053469 1.00
statpopgen_q02/duckdb:vortex-compact 550340012 555825031 0.99
statpopgen_q03/duckdb:vortex-compact 1147034144 1162415409 0.99
statpopgen_q04/duckdb:vortex-compact 1154591527 1150873280 1.00
statpopgen_q05/duckdb:vortex-compact 591104238 569607757 1.04
statpopgen_q06/duckdb:vortex-compact 1480014917 1489218038 0.99
statpopgen_q07/duckdb:vortex-compact 869658344 866251565 1.00
statpopgen_q08/duckdb:vortex-compact 898299176 903750753 0.99
statpopgen_q09/duckdb:vortex-compact 924572485 948626526 0.97
statpopgen_q10/duckdb:vortex-compact 2599111064 2587742202 1.00
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 347439983 340315894 1.02
statpopgen_q01/duckdb:parquet 426244122 416255286 1.02
statpopgen_q02/duckdb:parquet 804015591 802384872 1.00
statpopgen_q03/duckdb:parquet 1222991018 1212683833 1.01
statpopgen_q04/duckdb:parquet 1229836310 1226019489 1.00
statpopgen_q05/duckdb:parquet 854516678 838449204 1.02
statpopgen_q06/duckdb:parquet 1470023643 1438837118 1.02
statpopgen_q07/duckdb:parquet 909508522 863960655 1.05
statpopgen_q08/duckdb:parquet 925625819 905142915 1.02
statpopgen_q09/duckdb:parquet 1062959249 1047063964 1.02
statpopgen_q10/duckdb:parquet 2265619359 2288079779 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Engines: DataFusion No clear signal (+2.6%, low confidence) · DuckDB No clear signal (+2.0%, low confidence)
Vortex (geomean): 1.060x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.043x ➖, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 471759472 461570384 1.02
clickbench-sorted_q24/datafusion:vortex-file-compressed 22869429 24873577 0.92
clickbench-sorted_q26/datafusion:vortex-file-compressed 22348707 23689990 0.94
clickbench-sorted_q36/datafusion:vortex-file-compressed 🚨 65523328 57309784 1.14
clickbench-sorted_q37/datafusion:vortex-file-compressed 46259901 42430266 1.09
clickbench-sorted_q38/datafusion:vortex-file-compressed 44287595 42552267 1.04
clickbench-sorted_q39/datafusion:vortex-file-compressed 119876860 112017949 1.07
clickbench-sorted_q40/datafusion:vortex-file-compressed 🚨 22859381 20619567 1.11
clickbench-sorted_q41/datafusion:vortex-file-compressed 21700370 20171270 1.08
clickbench-sorted_q42/datafusion:vortex-file-compressed 15254611 14713220 1.04
datafusion / parquet (1.017x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4990794542 4745458448 1.05
clickbench-sorted_q24/datafusion:parquet 30777370 30661213 1.00
clickbench-sorted_q26/datafusion:parquet 28276089 29326778 0.96
clickbench-sorted_q36/datafusion:parquet 182211445 174667167 1.04
clickbench-sorted_q37/datafusion:parquet 108083474 105223627 1.03
clickbench-sorted_q38/datafusion:parquet 170178906 159856627 1.06
clickbench-sorted_q39/datafusion:parquet 303809205 291021834 1.04
clickbench-sorted_q40/datafusion:parquet 68033327 73604529 0.92
clickbench-sorted_q41/datafusion:parquet 61896993 61656139 1.00
clickbench-sorted_q42/datafusion:parquet 33179324 31595233 1.05
duckdb / vortex-file-compressed (1.077x ➖, 0↑ 5↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 169141033 178944565 0.95
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 29591539 26070269 1.14
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚨 48261592 39505058 1.22
clickbench-sorted_q36/duckdb:vortex-file-compressed 63934969 61280314 1.04
clickbench-sorted_q37/duckdb:vortex-file-compressed 47359375 46486542 1.02
clickbench-sorted_q38/duckdb:vortex-file-compressed 53889010 50484034 1.07
clickbench-sorted_q39/duckdb:vortex-file-compressed 118929117 114700339 1.04
clickbench-sorted_q40/duckdb:vortex-file-compressed 🚨 31383240 28095523 1.12
clickbench-sorted_q41/duckdb:vortex-file-compressed 🚨 30867330 27923020 1.11
clickbench-sorted_q42/duckdb:vortex-file-compressed 🚨 27738371 25145617 1.10
duckdb / parquet (1.029x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 202058944 198182031 1.02
clickbench-sorted_q24/duckdb:parquet 30268559 28361083 1.07
clickbench-sorted_q26/duckdb:parquet 24997112 24748473 1.01
clickbench-sorted_q36/duckdb:parquet 114538536 105674778 1.08
clickbench-sorted_q37/duckdb:parquet 96415038 94075074 1.02
clickbench-sorted_q38/duckdb:parquet 98572024 95039944 1.04
clickbench-sorted_q39/duckdb:parquet 182974300 181963309 1.01
clickbench-sorted_q40/duckdb:parquet 43204834 43336980 1.00
clickbench-sorted_q41/duckdb:parquet 42377791 41698704 1.02
clickbench-sorted_q42/duckdb:parquet 30847443 29825655 1.03
duckdb / duckdb (1.024x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:duckdb 296851411 275094285 1.08
clickbench-sorted_q24/duckdb:duckdb 46244047 44815632 1.03
clickbench-sorted_q26/duckdb:duckdb 43037763 43896276 0.98
clickbench-sorted_q36/duckdb:duckdb 91695810 87536191 1.05
clickbench-sorted_q37/duckdb:duckdb 83676818 81968380 1.02
clickbench-sorted_q38/duckdb:duckdb 64375024 65517525 0.98
clickbench-sorted_q39/duckdb:duckdb 121357265 120439015 1.01
clickbench-sorted_q40/duckdb:duckdb 45760251 44305197 1.03
clickbench-sorted_q41/duckdb:duckdb 44396479 42595783 1.04
clickbench-sorted_q42/duckdb:duckdb 36622714 35868055 1.02
File Size Changes (201 files changed, -0.0% overall, 99↑ 102↓)
File Scale Format Base HEAD Change %
hits_087.vortex 1.0 vortex-compact 123.82 MB 125.79 MB +1.96 MB +1.6%
hits_027.vortex 1.0 vortex-file-compressed 191.65 MB 194.42 MB +2.77 MB +1.4%
hits_012.vortex 1.0 vortex-compact 138.74 MB 140.07 MB +1.33 MB +1.0%
hits_075.vortex 1.0 vortex-compact 137.86 MB 139.15 MB +1.30 MB +0.9%
hits_060.vortex 1.0 vortex-compact 139.92 MB 141.17 MB +1.25 MB +0.9%
hits_030.vortex 1.0 vortex-compact 97.99 MB 98.80 MB +832.47 KB +0.8%
hits_076.vortex 1.0 vortex-compact 124.65 MB 125.50 MB +868.79 KB +0.7%
hits_033.vortex 1.0 vortex-file-compressed 198.72 MB 199.99 MB +1.26 MB +0.6%
hits_007.vortex 1.0 vortex-file-compressed 198.97 MB 200.09 MB +1.13 MB +0.6%
hits_057.vortex 1.0 vortex-file-compressed 159.97 MB 160.79 MB +841.79 KB +0.5%
hits_039.vortex 1.0 vortex-compact 124.94 MB 125.55 MB +623.93 KB +0.5%
hits_006.vortex 1.0 vortex-compact 95.46 MB 95.89 MB +441.95 KB +0.5%
hits_005.vortex 1.0 vortex-file-compressed 167.52 MB 168.25 MB +746.29 KB +0.4%
hits_028.vortex 1.0 vortex-file-compressed 152.03 MB 152.69 MB +670.73 KB +0.4%
hits_035.vortex 1.0 vortex-file-compressed 102.59 MB 103.02 MB +446.48 KB +0.4%
hits_036.vortex 1.0 vortex-file-compressed 171.34 MB 172.02 MB +692.63 KB +0.4%
hits_040.vortex 1.0 vortex-file-compressed 142.96 MB 143.46 MB +506.95 KB +0.3%
hits_097.vortex 1.0 vortex-file-compressed 192.75 MB 193.41 MB +678.27 KB +0.3%
hits_005.vortex 1.0 vortex-compact 115.84 MB 116.22 MB +380.95 KB +0.3%
hits_037.vortex 1.0 vortex-compact 132.24 MB 132.66 MB +428.87 KB +0.3%
hits_070.vortex 1.0 vortex-file-compressed 198.38 MB 199.00 MB +638.84 KB +0.3%
hits_097.vortex 1.0 vortex-compact 141.22 MB 141.65 MB +440.16 KB +0.3%
hits_054.vortex 1.0 vortex-compact 112.03 MB 112.34 MB +318.70 KB +0.3%
hits_077.vortex 1.0 vortex-file-compressed 172.57 MB 173.05 MB +486.98 KB +0.3%
hits_038.vortex 1.0 vortex-file-compressed 190.08 MB 190.59 MB +514.69 KB +0.3%
hits_036.vortex 1.0 vortex-compact 133.28 MB 133.63 MB +360.28 KB +0.3%
hits_014.vortex 1.0 vortex-compact 133.73 MB 134.08 MB +359.22 KB +0.3%
hits_052.vortex 1.0 vortex-file-compressed 130.86 MB 131.18 MB +329.16 KB +0.2%
hits_055.vortex 1.0 vortex-file-compressed 199.29 MB 199.76 MB +481.99 KB +0.2%
hits_078.vortex 1.0 vortex-file-compressed 130.91 MB 131.21 MB +300.97 KB +0.2%
hits_074.vortex 1.0 vortex-compact 152.82 MB 153.15 MB +339.07 KB +0.2%
hits_010.vortex 1.0 vortex-compact 123.10 MB 123.36 MB +259.57 KB +0.2%
hits_037.vortex 1.0 vortex-file-compressed 177.16 MB 177.51 MB +358.56 KB +0.2%
hits_022.vortex 1.0 vortex-file-compressed 199.19 MB 199.58 MB +394.48 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.20 MB 180.55 MB +355.27 KB +0.2%
hits_025.vortex 1.0 vortex-compact 133.49 MB 133.73 MB +247.65 KB +0.2%
hits_045.vortex 1.0 vortex-compact 106.06 MB 106.24 MB +186.09 KB +0.2%
hits_065.vortex 1.0 vortex-file-compressed 161.20 MB 161.45 MB +261.33 KB +0.2%
hits_073.vortex 1.0 vortex-file-compressed 172.61 MB 172.88 MB +274.49 KB +0.2%
hits_050.vortex 1.0 vortex-compact 125.13 MB 125.32 MB +191.06 KB +0.1%
hits_041.vortex 1.0 vortex-compact 98.26 MB 98.40 MB +148.37 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.19 MB 102.33 MB +144.07 KB +0.1%
hits_098.vortex 1.0 vortex-compact 103.86 MB 104.01 MB +145.82 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.79 MB 152.96 MB +171.18 KB +0.1%
hits_099.vortex 1.0 vortex-compact 132.89 MB 133.04 MB +147.31 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 101.28 MB 101.38 MB +106.83 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.99 MB 169.16 MB +176.52 KB +0.1%
hits_085.vortex 1.0 vortex-compact 153.20 MB 153.35 MB +155.12 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.86 MB 126.98 MB +119.15 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.98 MB 140.11 MB +126.07 KB +0.1%
hits_058.vortex 1.0 vortex-compact 111.06 MB 111.16 MB +99.33 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.31 MB 195.48 MB +174.05 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 131.69 MB 131.80 MB +114.00 KB +0.1%
hits_052.vortex 1.0 vortex-compact 97.92 MB 98.00 MB +84.62 KB +0.1%
hits_023.vortex 1.0 vortex-compact 142.62 MB 142.74 MB +120.03 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.41 MB 101.49 MB +84.27 KB +0.1%
hits_033.vortex 1.0 vortex-compact 153.22 MB 153.35 MB +127.30 KB +0.1%
hits_068.vortex 1.0 vortex-compact 112.46 MB 112.55 MB +91.57 KB +0.1%
hits_094.vortex 1.0 vortex-compact 110.72 MB 110.81 MB +85.27 KB +0.1%
hits_062.vortex 1.0 vortex-compact 132.65 MB 132.75 MB +99.12 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.71 MB 154.81 MB +110.23 KB +0.1%
hits_062.vortex 1.0 vortex-file-compressed 170.61 MB 170.72 MB +115.77 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 131.41 MB 131.50 MB +87.60 KB +0.1%
hits_008.vortex 1.0 vortex-compact 106.12 MB 106.19 MB +69.35 KB +0.1%
hits_082.vortex 1.0 vortex-compact 105.73 MB 105.79 MB +65.39 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.51 MB 126.58 MB +77.57 KB +0.1%
hits_020.vortex 1.0 vortex-compact 111.63 MB 111.70 MB +66.77 KB +0.1%
hits_019.vortex 1.0 vortex-compact 106.59 MB 106.65 MB +61.45 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 157.04 MB 157.13 MB +87.68 KB +0.1%
hits_048.vortex 1.0 vortex-file-compressed 199.48 MB 199.58 MB +107.21 KB +0.1%
hits_007.vortex 1.0 vortex-compact 153.71 MB 153.79 MB +81.77 KB +0.1%
hits_051.vortex 1.0 vortex-compact 133.94 MB 134.01 MB +70.62 KB +0.1%
hits_012.vortex 1.0 vortex-file-compressed 190.80 MB 190.89 MB +100.05 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.86 MB 140.92 MB +67.82 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.58 MB 192.67 MB +92.19 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.27 MB 147.33 MB +65.13 KB +0.0%
hits_077.vortex 1.0 vortex-compact 134.44 MB 134.49 MB +54.89 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 131.29 MB 131.34 MB +51.45 KB +0.0%
hits_090.vortex 1.0 vortex-compact 141.22 MB 141.28 MB +51.89 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.54 MB 136.59 MB +50.15 KB +0.0%
hits_070.vortex 1.0 vortex-compact 153.65 MB 153.70 MB +53.77 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.36 MB 126.40 MB +37.84 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 199.10 MB 199.16 MB +58.62 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.68 MB 154.72 MB +42.20 KB +0.0%
hits_046.vortex 1.0 vortex-compact 74.91 MB 74.93 MB +17.51 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 199.19 MB 199.24 MB +45.66 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 131.50 MB 131.53 MB +29.62 KB +0.0%
hits_089.vortex 1.0 vortex-file-compressed 131.52 MB 131.55 MB +29.41 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.98 MB 182.01 MB +37.40 KB +0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.51 MB 191.54 MB +25.71 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.30 MB 153.32 MB +20.18 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.10 MB 172.12 MB +19.67 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 131.77 MB 131.78 MB +11.57 KB +0.0%
hits_074.vortex 1.0 vortex-file-compressed 199.08 MB 199.09 MB +14.31 KB +0.0%
hits_043.vortex 1.0 vortex-compact 94.06 MB 94.07 MB +6.23 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.27 MB 136.28 MB +7.66 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.12 MB 147.13 MB +7.10 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.21 MB 134.22 MB +6.47 KB +0.0%
hits_026.vortex 1.0 vortex-compact 97.90 MB 97.90 MB +3.54 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 110.48 MB 1.13 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.10 MB 202.09 MB 2.11 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.63 MB 110.62 MB 3.05 KB -0.0%
hits_002.vortex 1.0 vortex-compact 124.18 MB 124.17 MB 4.21 KB -0.0%
hits_049.vortex 1.0 vortex-compact 139.32 MB 139.31 MB 5.67 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 140.07 MB 140.06 MB 5.76 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.64 MB 110.64 MB 5.76 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.76 MB 135.75 MB 8.72 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.24 MB 142.23 MB 14.80 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 140.13 MB 140.11 MB 16.20 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.54 MB 104.52 MB 12.79 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.95 MB 131.93 MB 19.02 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 75.22 MB 11.57 KB -0.0%
hits_057.vortex 1.0 vortex-compact 111.78 MB 111.76 MB 17.99 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.25 MB 161.22 MB 26.88 KB -0.0%
hits_040.vortex 1.0 vortex-compact 110.05 MB 110.03 MB 18.83 KB -0.0%
hits_061.vortex 1.0 vortex-compact 123.83 MB 123.81 MB 21.88 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.94 MB 75.93 MB 14.41 KB -0.0%
hits_038.vortex 1.0 vortex-compact 139.55 MB 139.52 MB 28.28 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 160.49 MB 160.45 MB 35.52 KB -0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.26 MB 171.22 MB 38.81 KB -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.73 MB 137.69 MB 38.45 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.64 MB 75.62 MB 22.51 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.11 MB 161.06 MB 50.09 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 199.71 MB 199.64 MB 62.70 KB -0.0%
hits_083.vortex 1.0 vortex-compact 110.06 MB 110.02 MB 36.71 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.49 MB 154.44 MB 55.23 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.15 MB 161.09 MB 62.84 KB -0.0%
hits_022.vortex 1.0 vortex-compact 153.12 MB 153.06 MB 61.93 KB -0.0%
hits_056.vortex 1.0 vortex-compact 101.40 MB 101.36 MB 41.52 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.79 MB 160.72 MB 66.59 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.68 MB 110.63 MB 49.79 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.60 MB 189.51 MB 92.58 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.48 MB 154.40 MB 88.93 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.52 MB 155.43 MB 92.19 KB -0.1%
hits_081.vortex 1.0 vortex-compact 153.84 MB 153.75 MB 91.96 KB -0.1%
hits_089.vortex 1.0 vortex-compact 98.92 MB 98.86 MB 60.42 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 199.60 MB 199.46 MB 138.01 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.35 MB 193.19 MB 165.88 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.62 MB 127.52 MB 109.95 KB -0.1%
hits_034.vortex 1.0 vortex-compact 133.47 MB 133.35 MB 131.12 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.25 MB 153.10 MB 153.95 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.80 MB 160.64 MB 168.22 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 163.19 MB 163.03 MB 171.42 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.99 MB 199.78 MB 214.52 KB -0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.10 MB 160.92 MB 185.16 KB -0.1%
hits_000.vortex 1.0 vortex-compact 99.07 MB 98.95 MB 128.52 KB -0.1%
hits_027.vortex 1.0 vortex-compact 139.40 MB 139.22 MB 181.80 KB -0.1%
hits_088.vortex 1.0 vortex-compact 134.42 MB 134.23 MB 190.32 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.06 MB 160.84 MB 228.78 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 199.46 MB 199.16 MB 305.76 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.40 MB 200.10 MB 311.02 KB -0.2%
hits_029.vortex 1.0 vortex-compact 153.57 MB 153.33 MB 240.94 KB -0.2%
hits_063.vortex 1.0 vortex-file-compressed 131.80 MB 131.59 MB 216.27 KB -0.2%
hits_044.vortex 1.0 vortex-compact 153.74 MB 153.48 MB 265.83 KB -0.2%
hits_059.vortex 1.0 vortex-compact 152.94 MB 152.68 MB 267.34 KB -0.2%
hits_086.vortex 1.0 vortex-file-compressed 192.37 MB 192.02 MB 358.27 KB -0.2%
hits_028.vortex 1.0 vortex-compact 115.91 MB 115.69 MB 219.57 KB -0.2%
hits_079.vortex 1.0 vortex-compact 128.20 MB 127.95 MB 246.17 KB -0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.80 MB 160.47 MB 345.28 KB -0.2%
hits_041.vortex 1.0 vortex-file-compressed 131.45 MB 131.17 MB 290.85 KB -0.2%
hits_031.vortex 1.0 vortex-compact 111.43 MB 111.18 MB 247.71 KB -0.2%
hits_064.vortex 1.0 vortex-compact 140.34 MB 140.03 MB 317.05 KB -0.2%
hits_069.vortex 1.0 vortex-compact 99.85 MB 99.62 MB 226.15 KB -0.2%
hits_076.vortex 1.0 vortex-file-compressed 161.41 MB 161.05 MB 369.80 KB -0.2%
hits_084.vortex 1.0 vortex-file-compressed 155.00 MB 154.57 MB 437.80 KB -0.3%
hits_091.vortex 1.0 vortex-compact 112.18 MB 111.86 MB 320.98 KB -0.3%
hits_017.vortex 1.0 vortex-compact 112.40 MB 112.06 MB 345.12 KB -0.3%
hits_084.vortex 1.0 vortex-compact 111.02 MB 110.69 MB 343.71 KB -0.3%
hits_031.vortex 1.0 vortex-file-compressed 160.21 MB 159.71 MB 509.36 KB -0.3%
hits_053.vortex 1.0 vortex-compact 138.96 MB 138.52 MB 444.23 KB -0.3%
hits_051.vortex 1.0 vortex-file-compressed 173.02 MB 172.48 MB 558.09 KB -0.3%
hits_078.vortex 1.0 vortex-compact 97.83 MB 97.50 MB 334.48 KB -0.3%
hits_025.vortex 1.0 vortex-file-compressed 172.50 MB 171.90 MB 616.02 KB -0.3%
hits_093.vortex 1.0 vortex-file-compressed 132.12 MB 131.65 MB 479.25 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 140.63 MB 140.11 MB 535.66 KB -0.4%
hits_071.vortex 1.0 vortex-compact 106.19 MB 105.75 MB 454.12 KB -0.4%
hits_048.vortex 1.0 vortex-compact 153.20 MB 152.56 MB 659.43 KB -0.4%
hits_013.vortex 1.0 vortex-compact 124.47 MB 123.90 MB 589.19 KB -0.5%
hits_088.vortex 1.0 vortex-file-compressed 172.99 MB 172.15 MB 855.96 KB -0.5%
hits_004.vortex 1.0 vortex-compact 98.44 MB 97.97 MB 489.59 KB -0.5%
hits_055.vortex 1.0 vortex-compact 153.25 MB 152.47 MB 801.59 KB -0.5%
hits_085.vortex 1.0 vortex-file-compressed 199.56 MB 198.49 MB 1.07 MB -0.5%
hits_054.vortex 1.0 vortex-file-compressed 147.84 MB 146.98 MB 876.74 KB -0.6%
hits_018.vortex 1.0 vortex-compact 153.85 MB 152.93 MB 937.99 KB -0.6%
hits_080.vortex 1.0 vortex-compact 96.74 MB 96.15 MB 599.12 KB -0.6%
hits_029.vortex 1.0 vortex-file-compressed 199.85 MB 198.55 MB 1.29 MB -0.6%
hits_094.vortex 1.0 vortex-file-compressed 159.49 MB 158.35 MB 1.14 MB -0.7%
hits_063.vortex 1.0 vortex-compact 98.90 MB 98.18 MB 737.86 KB -0.7%
hits_015.vortex 1.0 vortex-compact 98.13 MB 97.38 MB 772.19 KB -0.8%
hits_079.vortex 1.0 vortex-file-compressed 182.46 MB 181.03 MB 1.43 MB -0.8%
hits_066.vortex 1.0 vortex-compact 117.69 MB 116.73 MB 986.30 KB -0.8%
hits_067.vortex 1.0 vortex-compact 99.26 MB 98.38 MB 896.60 KB -0.9%
hits_093.vortex 1.0 vortex-compact 99.09 MB 98.19 MB 921.11 KB -0.9%
hits_086.vortex 1.0 vortex-compact 140.83 MB 139.53 MB 1.30 MB -0.9%
hits_024.vortex 1.0 vortex-compact 125.12 MB 123.95 MB 1.16 MB -0.9%
hits_053.vortex 1.0 vortex-file-compressed 192.07 MB 189.96 MB 2.12 MB -1.1%
hits_064.vortex 1.0 vortex-file-compressed 193.02 MB 190.85 MB 2.17 MB -1.1%
hits_065.vortex 1.0 vortex-compact 125.65 MB 124.15 MB 1.50 MB -1.2%
hits_001.vortex 1.0 vortex-compact 140.48 MB 137.71 MB 2.77 MB -2.0%
hits_001.vortex 1.0 vortex-file-compressed 193.85 MB 189.05 MB 4.81 MB -2.5%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (-0.1%)
  • vortex-file-compressed: 15.97 GB → 15.97 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+3.7%, environment too noisy confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): 0.948x ➖
Parquet (geomean): 0.942x ➖
Shifts: Parquet (control) -5.8% · Median polish -4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.930x ➖, 3↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 433989553 464608341 0.93
tpch_q02/datafusion:vortex-file-compressed 99758565 109147041 0.91
tpch_q03/datafusion:vortex-file-compressed 192203057 210637707 0.91
tpch_q04/datafusion:vortex-file-compressed 🚀 93296233 105241886 0.89
tpch_q05/datafusion:vortex-file-compressed 337200042 367918152 0.92
tpch_q06/datafusion:vortex-file-compressed 38648833 41265422 0.94
tpch_q07/datafusion:vortex-file-compressed 449864913 477768602 0.94
tpch_q08/datafusion:vortex-file-compressed 331321035 364071593 0.91
tpch_q09/datafusion:vortex-file-compressed 585534186 621438402 0.94
tpch_q10/datafusion:vortex-file-compressed 223020326 237291638 0.94
tpch_q11/datafusion:vortex-file-compressed 🚀 78807814 87850886 0.90
tpch_q12/datafusion:vortex-file-compressed 113574058 123308818 0.92
tpch_q13/datafusion:vortex-file-compressed 🚀 194971187 222645893 0.88
tpch_q14/datafusion:vortex-file-compressed 51584727 53661778 0.96
tpch_q15/datafusion:vortex-file-compressed 100995258 103556339 0.98
tpch_q16/datafusion:vortex-file-compressed 74673634 77884377 0.96
tpch_q17/datafusion:vortex-file-compressed 573718662 607331875 0.94
tpch_q18/datafusion:vortex-file-compressed 824064818 889153021 0.93
tpch_q19/datafusion:vortex-file-compressed 78290199 80134533 0.98
tpch_q20/datafusion:vortex-file-compressed 156727595 167255597 0.94
tpch_q21/datafusion:vortex-file-compressed 590636773 623456452 0.95
tpch_q22/datafusion:vortex-file-compressed 55735564 61631217 0.90
datafusion / vortex-compact (0.942x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 520134507 534125453 0.97
tpch_q02/datafusion:vortex-compact 106792763 112344310 0.95
tpch_q03/datafusion:vortex-compact 212020267 221960726 0.96
tpch_q04/datafusion:vortex-compact 128493539 132627542 0.97
tpch_q05/datafusion:vortex-compact 346324009 370561390 0.93
tpch_q06/datafusion:vortex-compact 63942333 62689988 1.02
tpch_q07/datafusion:vortex-compact 485428947 504540731 0.96
tpch_q08/datafusion:vortex-compact 352232275 381870849 0.92
tpch_q09/datafusion:vortex-compact 607632638 662587515 0.92
tpch_q10/datafusion:vortex-compact 272977234 296185305 0.92
tpch_q11/datafusion:vortex-compact 80019575 86106624 0.93
tpch_q12/datafusion:vortex-compact 176158334 188341019 0.94
tpch_q13/datafusion:vortex-compact 241784896 262773634 0.92
tpch_q14/datafusion:vortex-compact 68150235 72627824 0.94
tpch_q15/datafusion:vortex-compact 154651041 166663226 0.93
tpch_q16/datafusion:vortex-compact 78456805 85224217 0.92
tpch_q17/datafusion:vortex-compact 583067262 636864451 0.92
tpch_q18/datafusion:vortex-compact 855527655 908543420 0.94
tpch_q19/datafusion:vortex-compact 204026724 209385179 0.97
tpch_q20/datafusion:vortex-compact 180860035 190859195 0.95
tpch_q21/datafusion:vortex-compact 671494824 708022723 0.95
tpch_q22/datafusion:vortex-compact 61340695 67053877 0.91
datafusion / parquet (0.890x ✅, 10↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 471147803 608379997 0.77
tpch_q02/datafusion:parquet 🚀 178237530 214978339 0.83
tpch_q03/datafusion:parquet 🚀 260607226 330370933 0.79
tpch_q04/datafusion:parquet 🚀 119780435 149452125 0.80
tpch_q05/datafusion:parquet 🚀 394444057 502523434 0.78
tpch_q06/datafusion:parquet 128962523 139055315 0.93
tpch_q07/datafusion:parquet 566394454 615607591 0.92
tpch_q08/datafusion:parquet 🚀 450337690 516735935 0.87
tpch_q09/datafusion:parquet 🚀 724002164 828505436 0.87
tpch_q10/datafusion:parquet 578181406 633261431 0.91
tpch_q11/datafusion:parquet 🚀 121267254 135201165 0.90
tpch_q12/datafusion:parquet 212934878 234094088 0.91
tpch_q13/datafusion:parquet 345859545 365111101 0.95
tpch_q14/datafusion:parquet 🚀 149422350 167405787 0.89
tpch_q15/datafusion:parquet 262437767 284123417 0.92
tpch_q16/datafusion:parquet 122535763 130447165 0.94
tpch_q17/datafusion:parquet 660117830 727251451 0.91
tpch_q18/datafusion:parquet 🚀 853242976 956655253 0.89
tpch_q19/datafusion:parquet 277941853 292096633 0.95
tpch_q20/datafusion:parquet 298105486 310585927 0.96
tpch_q21/datafusion:parquet 653023724 694144469 0.94
tpch_q22/datafusion:parquet 211679544 213992561 0.99
datafusion / arrow (0.898x ✅, 9↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 687675448 770469891 0.89
tpch_q02/datafusion:arrow 🚀 113488566 129918290 0.87
tpch_q03/datafusion:arrow 🚀 499441687 594468427 0.84
tpch_q04/datafusion:arrow 🚀 366194477 452177020 0.81
tpch_q05/datafusion:arrow 739365787 816183330 0.91
tpch_q06/datafusion:arrow 319482417 354609724 0.90
tpch_q07/datafusion:arrow 🚀 1137717689 1267012197 0.90
tpch_q08/datafusion:arrow 952709995 1043171174 0.91
tpch_q09/datafusion:arrow 1080199190 1149028623 0.94
tpch_q10/datafusion:arrow 641173242 704111261 0.91
tpch_q11/datafusion:arrow 93382619 94808442 0.98
tpch_q12/datafusion:arrow 1424126459 1435403593 0.99
tpch_q13/datafusion:arrow 476847631 495225679 0.96
tpch_q14/datafusion:arrow 365152610 399125539 0.91
tpch_q15/datafusion:arrow 🚀 748998780 863299076 0.87
tpch_q16/datafusion:arrow 81254050 87160912 0.93
tpch_q17/datafusion:arrow 966699583 1047205116 0.92
tpch_q18/datafusion:arrow 1831493702 2006323185 0.91
tpch_q19/datafusion:arrow 554082197 592872027 0.93
tpch_q20/datafusion:arrow 🚀 501649104 566387212 0.89
tpch_q21/datafusion:arrow 🚀 3110736566 3520879456 0.88
tpch_q22/datafusion:arrow 🚀 81684677 113435254 0.72
duckdb / vortex-file-compressed (0.968x ➖, 1↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 168913640 171696064 0.98
tpch_q02/duckdb:vortex-file-compressed 51568166 54367215 0.95
tpch_q03/duckdb:vortex-file-compressed 120197192 124473470 0.97
tpch_q04/duckdb:vortex-file-compressed 144250793 158472348 0.91
tpch_q05/duckdb:vortex-file-compressed 134029825 138015949 0.97
tpch_q06/duckdb:vortex-file-compressed 35710267 35013682 1.02
tpch_q07/duckdb:vortex-file-compressed 🚀 119148919 132676079 0.90
tpch_q08/duckdb:vortex-file-compressed 164281083 172926745 0.95
tpch_q09/duckdb:vortex-file-compressed 377175893 395968921 0.95
tpch_q10/duckdb:vortex-file-compressed 190203876 194140438 0.98
tpch_q11/duckdb:vortex-file-compressed 31402621 30903840 1.02
tpch_q12/duckdb:vortex-file-compressed 103110103 107404156 0.96
tpch_q13/duckdb:vortex-file-compressed 267771690 271081891 0.99
tpch_q14/duckdb:vortex-file-compressed 51110161 54961029 0.93
tpch_q15/duckdb:vortex-file-compressed 89266641 90156073 0.99
tpch_q16/duckdb:vortex-file-compressed 75204073 80518966 0.93
tpch_q17/duckdb:vortex-file-compressed 88133217 88063652 1.00
tpch_q18/duckdb:vortex-file-compressed 289225606 293883480 0.98
tpch_q19/duckdb:vortex-file-compressed 75633132 74038396 1.02
tpch_q20/duckdb:vortex-file-compressed 137137669 139795190 0.98
tpch_q21/duckdb:vortex-file-compressed 452364981 482668272 0.94
tpch_q22/duckdb:vortex-file-compressed 63703672 64845292 0.98
duckdb / vortex-compact (0.953x ➖, 4↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 273700489 274966388 1.00
tpch_q02/duckdb:vortex-compact 59059206 62031017 0.95
tpch_q03/duckdb:vortex-compact 155688326 159265130 0.98
tpch_q04/duckdb:vortex-compact 🚀 182590456 219114322 0.83
tpch_q05/duckdb:vortex-compact 179845072 185574228 0.97
tpch_q06/duckdb:vortex-compact 58775573 58223898 1.01
tpch_q07/duckdb:vortex-compact 🚀 183875755 216409372 0.85
tpch_q08/duckdb:vortex-compact 205807919 221929004 0.93
tpch_q09/duckdb:vortex-compact 🚀 419652332 472057322 0.89
tpch_q10/duckdb:vortex-compact 251756265 259963538 0.97
tpch_q11/duckdb:vortex-compact 37691732 39948632 0.94
tpch_q12/duckdb:vortex-compact 190364132 192084460 0.99
tpch_q13/duckdb:vortex-compact 315350644 323875077 0.97
tpch_q14/duckdb:vortex-compact 70756270 73532805 0.96
tpch_q15/duckdb:vortex-compact 117949474 118611886 0.99
tpch_q16/duckdb:vortex-compact 79464594 79993207 0.99
tpch_q17/duckdb:vortex-compact 105806222 105038124 1.01
tpch_q18/duckdb:vortex-compact 345448045 352200065 0.98
tpch_q19/duckdb:vortex-compact 91507817 92476916 0.99
tpch_q20/duckdb:vortex-compact 173069490 183573907 0.94
tpch_q21/duckdb:vortex-compact 🚀 565572040 636943072 0.89
tpch_q22/duckdb:vortex-compact 70108916 72929042 0.96
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265347953 263439671 1.01
tpch_q02/duckdb:parquet 106143340 105581047 1.01
tpch_q03/duckdb:parquet 213402393 214899618 0.99
tpch_q04/duckdb:parquet 138934394 142033594 0.98
tpch_q05/duckdb:parquet 231888095 230101477 1.01
tpch_q06/duckdb:parquet 74942698 74951798 1.00
tpch_q07/duckdb:parquet 187463009 188398323 1.00
tpch_q08/duckdb:parquet 266394269 268349368 0.99
tpch_q09/duckdb:parquet 496795651 515656602 0.96
tpch_q10/duckdb:parquet 627527232 631916509 0.99
tpch_q11/duckdb:parquet 69538501 65671749 1.06
tpch_q12/duckdb:parquet 133380547 134710631 0.99
tpch_q13/duckdb:parquet 441949768 457673577 0.97
tpch_q14/duckdb:parquet 181763106 180827414 1.01
tpch_q15/duckdb:parquet 103148331 106942257 0.96
tpch_q16/duckdb:parquet 168757845 166031181 1.02
tpch_q17/duckdb:parquet 188276385 185644725 1.01
tpch_q18/duckdb:parquet 361478108 368920593 0.98
tpch_q19/duckdb:parquet 288909916 286513162 1.01
tpch_q20/duckdb:parquet 237092416 239006258 0.99
tpch_q21/duckdb:parquet 565494616 572758371 0.99
tpch_q22/duckdb:parquet 302721126 305247914 0.99
duckdb / duckdb (0.983x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120482533 120979941 1.00
tpch_q02/duckdb:duckdb 49998778 50163330 1.00
tpch_q03/duckdb:duckdb 103456353 105546060 0.98
tpch_q04/duckdb:duckdb 138310883 142878321 0.97
tpch_q05/duckdb:duckdb 118952946 119803221 0.99
tpch_q06/duckdb:duckdb 44565772 45131800 0.99
tpch_q07/duckdb:duckdb 91982257 91854903 1.00
tpch_q08/duckdb:duckdb 117588709 120187679 0.98
tpch_q09/duckdb:duckdb 281480349 285472489 0.99
tpch_q10/duckdb:duckdb 213520706 218276143 0.98
tpch_q11/duckdb:duckdb 19045649 19454131 0.98
tpch_q12/duckdb:duckdb 89704042 91855812 0.98
tpch_q13/duckdb:duckdb 228391642 235442274 0.97
tpch_q14/duckdb:duckdb 77522342 80571268 0.96
tpch_q15/duckdb:duckdb 81927512 83076747 0.99
tpch_q16/duckdb:duckdb 76581264 76690419 1.00
tpch_q17/duckdb:duckdb 87420267 88355356 0.99
tpch_q18/duckdb:duckdb 234986469 236634479 0.99
tpch_q19/duckdb:duckdb 123688689 124451670 0.99
tpch_q20/duckdb:duckdb 116908467 117364784 1.00
tpch_q21/duckdb:duckdb 301286104 305993390 0.98
tpch_q22/duckdb:duckdb 67732395 73088135 0.93

No file size changes detected.

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.003x ➖, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1633633 1567817 1.04
clickbench_q01/datafusion:vortex-file-compressed 18963140 18137232 1.05
clickbench_q02/datafusion:vortex-file-compressed 35035914 35155304 1.00
clickbench_q03/datafusion:vortex-file-compressed 36317688 38038976 0.95
clickbench_q04/datafusion:vortex-file-compressed 236809450 238050899 0.99
clickbench_q05/datafusion:vortex-file-compressed 311593659 304169826 1.02
clickbench_q06/datafusion:vortex-file-compressed 1664969 1610211 1.03
clickbench_q07/datafusion:vortex-file-compressed 23334981 23625363 0.99
clickbench_q08/datafusion:vortex-file-compressed 329227624 330581477 1.00
clickbench_q09/datafusion:vortex-file-compressed 449857604 455325059 0.99
clickbench_q10/datafusion:vortex-file-compressed 74487637 76147923 0.98
clickbench_q11/datafusion:vortex-file-compressed 84363272 88332789 0.96
clickbench_q12/datafusion:vortex-file-compressed 256917605 260134866 0.99
clickbench_q13/datafusion:vortex-file-compressed 426623760 417052296 1.02
clickbench_q14/datafusion:vortex-file-compressed 253600372 249636845 1.02
clickbench_q15/datafusion:vortex-file-compressed 282101858 287634652 0.98
clickbench_q16/datafusion:vortex-file-compressed 642849155 657089492 0.98
clickbench_q17/datafusion:vortex-file-compressed 647031900 640972203 1.01
clickbench_q18/datafusion:vortex-file-compressed 1336441961 1461080676 0.91
clickbench_q19/datafusion:vortex-file-compressed 🚨 33768939 28197759 1.20
clickbench_q20/datafusion:vortex-file-compressed 264689461 260729948 1.02
clickbench_q21/datafusion:vortex-file-compressed 352047175 350294916 1.01
clickbench_q22/datafusion:vortex-file-compressed 448809948 448810605 1.00
clickbench_q23/datafusion:vortex-file-compressed 630799408 641425732 0.98
clickbench_q24/datafusion:vortex-file-compressed 41294893 44799668 0.92
clickbench_q25/datafusion:vortex-file-compressed 74712594 74901540 1.00
clickbench_q26/datafusion:vortex-file-compressed 44445394 43515064 1.02
clickbench_q27/datafusion:vortex-file-compressed 362974864 373078332 0.97
clickbench_q28/datafusion:vortex-file-compressed 2302381977 2316971119 0.99
clickbench_q29/datafusion:vortex-file-compressed 52709153 55192357 0.96
clickbench_q30/datafusion:vortex-file-compressed 229680731 229050100 1.00
clickbench_q31/datafusion:vortex-file-compressed 245157788 244087819 1.00
clickbench_q32/datafusion:vortex-file-compressed 1028902883 1060335523 0.97
clickbench_q33/datafusion:vortex-file-compressed 1391621764 1386516078 1.00
clickbench_q34/datafusion:vortex-file-compressed 1386176043 1380926881 1.00
clickbench_q35/datafusion:vortex-file-compressed 240504036 234732704 1.02
clickbench_q36/datafusion:vortex-file-compressed 🚨 60622247 53517667 1.13
clickbench_q37/datafusion:vortex-file-compressed 24713913 24916362 0.99
clickbench_q38/datafusion:vortex-file-compressed 15529045 15715280 0.99
clickbench_q39/datafusion:vortex-file-compressed 121082149 120399293 1.01
clickbench_q40/datafusion:vortex-file-compressed 12415886 12879976 0.96
clickbench_q41/datafusion:vortex-file-compressed 12985275 11948292 1.09
clickbench_q42/datafusion:vortex-file-compressed 11595574 11460231 1.01
datafusion / parquet (1.006x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1568136 1571228 1.00
clickbench_q01/datafusion:parquet 19334559 19458128 0.99
clickbench_q02/datafusion:parquet 44044748 43127267 1.02
clickbench_q03/datafusion:parquet 35081276 33134805 1.06
clickbench_q04/datafusion:parquet 276754779 262765595 1.05
clickbench_q05/datafusion:parquet 311598021 326388724 0.95
clickbench_q06/datafusion:parquet 1514155 1528076 0.99
clickbench_q07/datafusion:parquet 20641715 21193289 0.97
clickbench_q08/datafusion:parquet 329404099 327478146 1.01
clickbench_q09/datafusion:parquet 467101324 473715538 0.99
clickbench_q10/datafusion:parquet 91023190 90963399 1.00
clickbench_q11/datafusion:parquet 115576614 116853363 0.99
clickbench_q12/datafusion:parquet 303975859 294184180 1.03
clickbench_q13/datafusion:parquet 465203712 470304780 0.99
clickbench_q14/datafusion:parquet 304235453 312584416 0.97
clickbench_q15/datafusion:parquet 274193683 273028594 1.00
clickbench_q16/datafusion:parquet 662075527 669481359 0.99
clickbench_q17/datafusion:parquet 652559964 647367435 1.01
clickbench_q18/datafusion:parquet 1387248388 1377831607 1.01
clickbench_q19/datafusion:parquet 26963400 26251701 1.03
clickbench_q20/datafusion:parquet 560933157 583693618 0.96
clickbench_q21/datafusion:parquet 623629962 623902836 1.00
clickbench_q22/datafusion:parquet 923145768 911341592 1.01
clickbench_q23/datafusion:parquet 4094079967 4031776126 1.02
clickbench_q24/datafusion:parquet 54773112 55167277 0.99
clickbench_q25/datafusion:parquet 127340831 127398379 1.00
clickbench_q26/datafusion:parquet 54472904 52047607 1.05
clickbench_q27/datafusion:parquet 639444019 648798974 0.99
clickbench_q28/datafusion:parquet 2424121376 2464350820 0.98
clickbench_q29/datafusion:parquet 🚨 50398509 43397385 1.16
clickbench_q30/datafusion:parquet 314496838 313634207 1.00
clickbench_q31/datafusion:parquet 347122461 341887376 1.02
clickbench_q32/datafusion:parquet 1134333172 1061991958 1.07
clickbench_q33/datafusion:parquet 1495045420 1489547165 1.00
clickbench_q34/datafusion:parquet 1487417110 1503348734 0.99
clickbench_q35/datafusion:parquet 243196381 246422335 0.99
clickbench_q36/datafusion:parquet 106846143 104377788 1.02
clickbench_q37/datafusion:parquet 45546262 42834832 1.06
clickbench_q38/datafusion:parquet 59024234 60664885 0.97
clickbench_q39/datafusion:parquet 206165974 204065800 1.01
clickbench_q40/datafusion:parquet 22431286 22944836 0.98
clickbench_q41/datafusion:parquet 20979585 21945231 0.96
clickbench_q42/datafusion:parquet 21423438 21901188 0.98
duckdb / vortex-file-compressed (0.993x ➖, 1↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9663965 10088013 0.96
clickbench_q01/duckdb:vortex-file-compressed 16044142 15719738 1.02
clickbench_q02/duckdb:vortex-file-compressed 20457391 20936333 0.98
clickbench_q03/duckdb:vortex-file-compressed 26402855 25953527 1.02
clickbench_q04/duckdb:vortex-file-compressed 200848666 202073749 0.99
clickbench_q05/duckdb:vortex-file-compressed 182619458 180863742 1.01
clickbench_q06/duckdb:vortex-file-compressed 18755946 18283594 1.03
clickbench_q07/duckdb:vortex-file-compressed 21012186 20220017 1.04
clickbench_q08/duckdb:vortex-file-compressed 266886972 266430936 1.00
clickbench_q09/duckdb:vortex-file-compressed 346938254 351452809 0.99
clickbench_q10/duckdb:vortex-file-compressed 76484343 74678302 1.02
clickbench_q11/duckdb:vortex-file-compressed 85287050 84952915 1.00
clickbench_q12/duckdb:vortex-file-compressed 210147737 212157666 0.99
clickbench_q13/duckdb:vortex-file-compressed 417421343 415468287 1.00
clickbench_q14/duckdb:vortex-file-compressed 244554822 249390462 0.98
clickbench_q15/duckdb:vortex-file-compressed 253289495 256162139 0.99
clickbench_q16/duckdb:vortex-file-compressed 540059697 544143667 0.99
clickbench_q17/duckdb:vortex-file-compressed 437530847 430527362 1.02
clickbench_q18/duckdb:vortex-file-compressed 948370112 953648974 0.99
clickbench_q19/duckdb:vortex-file-compressed 21062108 20659355 1.02
clickbench_q20/duckdb:vortex-file-compressed 248690213 254616453 0.98
clickbench_q21/duckdb:vortex-file-compressed 330928460 328995703 1.01
clickbench_q22/duckdb:vortex-file-compressed 513034209 482313695 1.06
clickbench_q23/duckdb:vortex-file-compressed 🚀 131776614 183788042 0.72
clickbench_q24/duckdb:vortex-file-compressed 🚨 45273548 39772271 1.14
clickbench_q25/duckdb:vortex-file-compressed 79965038 79578207 1.00
clickbench_q26/duckdb:vortex-file-compressed 51092874 51251512 1.00
clickbench_q27/duckdb:vortex-file-compressed 212036967 222561052 0.95
clickbench_q28/duckdb:vortex-file-compressed 3030694549 3032520053 1.00
clickbench_q29/duckdb:vortex-file-compressed 26238043 28324319 0.93
clickbench_q30/duckdb:vortex-file-compressed 204762682 202343183 1.01
clickbench_q31/duckdb:vortex-file-compressed 294591779 301195987 0.98
clickbench_q32/duckdb:vortex-file-compressed 1128076082 1127625166 1.00
clickbench_q33/duckdb:vortex-file-compressed 1090352076 1106889551 0.99
clickbench_q34/duckdb:vortex-file-compressed 1176123701 1189832909 0.99
clickbench_q35/duckdb:vortex-file-compressed 373709726 371478864 1.01
clickbench_q36/duckdb:vortex-file-compressed 29530977 28744152 1.03
clickbench_q37/duckdb:vortex-file-compressed 20557426 21473092 0.96
clickbench_q38/duckdb:vortex-file-compressed 24596273 23329262 1.05
clickbench_q39/duckdb:vortex-file-compressed 43377705 44619700 0.97
clickbench_q40/duckdb:vortex-file-compressed 20411694 20401058 1.00
clickbench_q41/duckdb:vortex-file-compressed 19145869 19646450 0.97
clickbench_q42/duckdb:vortex-file-compressed 21534659 21801832 0.99
duckdb / parquet (0.997x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23444027 24487846 0.96
clickbench_q01/duckdb:parquet 31126566 30863036 1.01
clickbench_q02/duckdb:parquet 51027200 50895222 1.00
clickbench_q03/duckdb:parquet 41659974 40150012 1.04
clickbench_q04/duckdb:parquet 204588371 206334653 0.99
clickbench_q05/duckdb:parquet 261700756 262246142 1.00
clickbench_q06/duckdb:parquet 48902578 48689469 1.00
clickbench_q07/duckdb:parquet 33054382 32722579 1.01
clickbench_q08/duckdb:parquet 274836188 274539087 1.00
clickbench_q09/duckdb:parquet 402612544 406178136 0.99
clickbench_q10/duckdb:parquet 84650244 84855628 1.00
clickbench_q11/duckdb:parquet 102752019 101731529 1.01
clickbench_q12/duckdb:parquet 280665154 285442237 0.98
clickbench_q13/duckdb:parquet 471065271 476757231 0.99
clickbench_q14/duckdb:parquet 319171777 319413273 1.00
clickbench_q15/duckdb:parquet 256137838 258003243 0.99
clickbench_q16/duckdb:parquet 598466190 603544585 0.99
clickbench_q17/duckdb:parquet 504471816 506086017 1.00
clickbench_q18/duckdb:parquet 1031268701 1039062911 0.99
clickbench_q19/duckdb:parquet 28608226 28825689 0.99
clickbench_q20/duckdb:parquet 415023112 416489071 1.00
clickbench_q21/duckdb:parquet 538696292 538177217 1.00
clickbench_q22/duckdb:parquet 923961620 931167398 0.99
clickbench_q23/duckdb:parquet 268925456 266238867 1.01
clickbench_q24/duckdb:parquet 71569662 73418948 0.97
clickbench_q25/duckdb:parquet 164959297 165202925 1.00
clickbench_q26/duckdb:parquet 53406061 56909075 0.94
clickbench_q27/duckdb:parquet 471852668 475621819 0.99
clickbench_q28/duckdb:parquet 4803953003 4790778841 1.00
clickbench_q29/duckdb:parquet 43175353 44097801 0.98
clickbench_q30/duckdb:parquet 312402097 311853882 1.00
clickbench_q31/duckdb:parquet 374554628 386621035 0.97
clickbench_q32/duckdb:parquet 1120744907 1114525384 1.01
clickbench_q33/duckdb:parquet 1118929241 1105981705 1.01
clickbench_q34/duckdb:parquet 1161127471 1158541464 1.00
clickbench_q35/duckdb:parquet 372376293 369774997 1.01
clickbench_q36/duckdb:parquet 50362020 48871192 1.03
clickbench_q37/duckdb:parquet 34528010 34334676 1.01
clickbench_q38/duckdb:parquet 35959629 37706252 0.95
clickbench_q39/duckdb:parquet 🚨 91636626 80032641 1.14
clickbench_q40/duckdb:parquet 21744772 22173931 0.98
clickbench_q41/duckdb:parquet 21797862 20976541 1.04
clickbench_q42/duckdb:parquet 22990322 24873844 0.92
duckdb / duckdb (1.002x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19104324 19313268 0.99
clickbench_q01/duckdb:duckdb 36023142 35885692 1.00
clickbench_q02/duckdb:duckdb 53665823 52719829 1.02
clickbench_q03/duckdb:duckdb 57734801 57051632 1.01
clickbench_q04/duckdb:duckdb 214491387 214824815 1.00
clickbench_q05/duckdb:duckdb 284124396 287012575 0.99
clickbench_q06/duckdb:duckdb 35888288 35822735 1.00
clickbench_q07/duckdb:duckdb 36554065 36059767 1.01
clickbench_q08/duckdb:duckdb 273950736 277129268 0.99
clickbench_q09/duckdb:duckdb 392947559 393697313 1.00
clickbench_q10/duckdb:duckdb 117795452 117586830 1.00
clickbench_q11/duckdb:duckdb 127399520 128917228 0.99
clickbench_q12/duckdb:duckdb 260779565 259614956 1.00
clickbench_q13/duckdb:duckdb 445383596 449113889 0.99
clickbench_q14/duckdb:duckdb 287641868 288186310 1.00
clickbench_q15/duckdb:duckdb 243639234 245218504 0.99
clickbench_q16/duckdb:duckdb 567876258 566769822 1.00
clickbench_q17/duckdb:duckdb 477236379 475260840 1.00
clickbench_q18/duckdb:duckdb 994723088 1046962345 0.95
clickbench_q19/duckdb:duckdb 35779446 36494671 0.98
clickbench_q20/duckdb:duckdb 468741292 463186383 1.01
clickbench_q21/duckdb:duckdb 471959495 474321465 1.00
clickbench_q22/duckdb:duckdb 542199011 556169696 0.97
clickbench_q23/duckdb:duckdb 252077367 254163475 0.99
clickbench_q24/duckdb:duckdb 63831203 64581663 0.99
clickbench_q25/duckdb:duckdb 151769317 151505454 1.00
clickbench_q26/duckdb:duckdb 63981757 63536471 1.01
clickbench_q27/duckdb:duckdb 422906403 413940351 1.02
clickbench_q28/duckdb:duckdb 4402000463 4401759198 1.00
clickbench_q29/duckdb:duckdb 52557148 52465450 1.00
clickbench_q30/duckdb:duckdb 285153928 278848266 1.02
clickbench_q31/duckdb:duckdb 360125675 373854185 0.96
clickbench_q32/duckdb:duckdb 1110541318 1120505921 0.99
clickbench_q33/duckdb:duckdb 1123987211 1120203267 1.00
clickbench_q34/duckdb:duckdb 1200408054 1199493028 1.00
clickbench_q35/duckdb:duckdb 300363554 302946774 0.99
clickbench_q36/duckdb:duckdb 52791261 50357222 1.05
clickbench_q37/duckdb:duckdb 29847959 30317695 0.98
clickbench_q38/duckdb:duckdb 36989395 35416878 1.04
clickbench_q39/duckdb:duckdb 🚨 92268127 81674479 1.13
clickbench_q40/duckdb:duckdb 29421623 29699983 0.99
clickbench_q41/duckdb:duckdb 28805572 28797341 1.00
clickbench_q42/duckdb:duckdb 31376364 30815193 1.02
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (-0.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+5.9%, environment too noisy confidence) · DuckDB No clear signal (-2.6%, environment too noisy confidence)
Vortex (geomean): 1.075x ➖
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish +8.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.053x ➖, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 251147385 265957706 0.94
tpch_q02/datafusion:vortex-file-compressed 447863563 506446634 0.88
tpch_q03/datafusion:vortex-file-compressed 418519529 418682763 1.00
tpch_q04/datafusion:vortex-file-compressed 201350268 250830567 0.80
tpch_q05/datafusion:vortex-file-compressed 368920710 430499382 0.86
tpch_q06/datafusion:vortex-file-compressed 318467518 302108209 1.05
tpch_q07/datafusion:vortex-file-compressed 485719942 430880200 1.13
tpch_q08/datafusion:vortex-file-compressed 509999863 465450831 1.10
tpch_q09/datafusion:vortex-file-compressed 🚨 452137274 321907272 1.40
tpch_q10/datafusion:vortex-file-compressed 455523605 412420254 1.10
tpch_q11/datafusion:vortex-file-compressed 🚨 337022633 252967021 1.33
tpch_q12/datafusion:vortex-file-compressed 438316718 367157981 1.19
tpch_q13/datafusion:vortex-file-compressed 192070136 188221542 1.02
tpch_q14/datafusion:vortex-file-compressed 262870841 227181806 1.16
tpch_q15/datafusion:vortex-file-compressed 479500143 431977102 1.11
tpch_q16/datafusion:vortex-file-compressed 220249262 210004859 1.05
tpch_q17/datafusion:vortex-file-compressed 469907904 365888328 1.28
tpch_q18/datafusion:vortex-file-compressed 282519093 250873885 1.13
tpch_q19/datafusion:vortex-file-compressed 468449846 470775943 1.00
tpch_q20/datafusion:vortex-file-compressed 437764608 383806938 1.14
tpch_q21/datafusion:vortex-file-compressed 537374533 516319854 1.04
tpch_q22/datafusion:vortex-file-compressed 153876166 212625659 0.72
datafusion / vortex-compact (1.147x ➖, 0↑ 4↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 254264001 247251105 1.03
tpch_q02/datafusion:vortex-compact 433210531 398419434 1.09
tpch_q03/datafusion:vortex-compact 383413164 393027962 0.98
tpch_q04/datafusion:vortex-compact 212907507 196827167 1.08
tpch_q05/datafusion:vortex-compact 383340571 322513073 1.19
tpch_q06/datafusion:vortex-compact 315895585 281300277 1.12
tpch_q07/datafusion:vortex-compact 492987892 395919457 1.25
tpch_q08/datafusion:vortex-compact 🚨 607543068 451015682 1.35
tpch_q09/datafusion:vortex-compact 486505042 383152090 1.27
tpch_q10/datafusion:vortex-compact 🚨 637779988 413420306 1.54
tpch_q11/datafusion:vortex-compact 🚨 497844590 253636282 1.96
tpch_q12/datafusion:vortex-compact 353442172 351634682 1.01
tpch_q13/datafusion:vortex-compact 158667481 198079834 0.80
tpch_q14/datafusion:vortex-compact 252984601 224102266 1.13
tpch_q15/datafusion:vortex-compact 423980864 400069813 1.06
tpch_q16/datafusion:vortex-compact 216660830 181730990 1.19
tpch_q17/datafusion:vortex-compact 383666815 376902566 1.02
tpch_q18/datafusion:vortex-compact 300289294 244665458 1.23
tpch_q19/datafusion:vortex-compact 🚨 652546429 500859144 1.30
tpch_q20/datafusion:vortex-compact 449565731 420877741 1.07
tpch_q21/datafusion:vortex-compact 498428247 488973388 1.02
tpch_q22/datafusion:vortex-compact 146748232 149763620 0.98
datafusion / parquet (1.038x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 236227555 234677333 1.01
tpch_q02/datafusion:parquet 409315836 386725401 1.06
tpch_q03/datafusion:parquet 337241300 305073099 1.11
tpch_q04/datafusion:parquet 150249375 155990580 0.96
tpch_q05/datafusion:parquet 437215530 422213755 1.04
tpch_q06/datafusion:parquet 143273910 141240377 1.01
tpch_q07/datafusion:parquet 450224394 430873443 1.04
tpch_q08/datafusion:parquet 533513645 519091065 1.03
tpch_q09/datafusion:parquet 460822016 447100339 1.03
tpch_q10/datafusion:parquet 453460313 456054260 0.99
tpch_q11/datafusion:parquet 369018232 367911111 1.00
tpch_q12/datafusion:parquet 228594111 220326765 1.04
tpch_q13/datafusion:parquet 424566309 423744759 1.00
tpch_q14/datafusion:parquet 196134033 162526957 1.21
tpch_q15/datafusion:parquet 312180590 294459611 1.06
tpch_q16/datafusion:parquet 186619762 167907231 1.11
tpch_q17/datafusion:parquet 407744138 348364655 1.17
tpch_q18/datafusion:parquet 419567712 425568696 0.99
tpch_q19/datafusion:parquet 365596004 294051896 1.24
tpch_q20/datafusion:parquet 312175030 325573837 0.96
tpch_q21/datafusion:parquet 525213303 548429118 0.96
tpch_q22/datafusion:parquet 165600509 187410807 0.88
duckdb / vortex-file-compressed (1.053x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 267894649 248519691 1.08
tpch_q02/duckdb:vortex-file-compressed 1049283840 913484730 1.15
tpch_q03/duckdb:vortex-file-compressed 644464152 579728806 1.11
tpch_q04/duckdb:vortex-file-compressed 383135706 352271564 1.09
tpch_q05/duckdb:vortex-file-compressed 775988105 799920955 0.97
tpch_q06/duckdb:vortex-file-compressed 342864345 329725403 1.04
tpch_q07/duckdb:vortex-file-compressed 933140747 833794717 1.12
tpch_q08/duckdb:vortex-file-compressed 1131357140 1047140603 1.08
tpch_q09/duckdb:vortex-file-compressed 891102345 839649189 1.06
tpch_q10/duckdb:vortex-file-compressed 740928828 670345813 1.11
tpch_q11/duckdb:vortex-file-compressed 525086191 502943732 1.04
tpch_q12/duckdb:vortex-file-compressed 616043074 591085121 1.04
tpch_q13/duckdb:vortex-file-compressed 350737205 420168417 0.83
tpch_q14/duckdb:vortex-file-compressed 389451603 355944629 1.09
tpch_q15/duckdb:vortex-file-compressed 305812766 272723952 1.12
tpch_q16/duckdb:vortex-file-compressed 337103620 321383058 1.05
tpch_q17/duckdb:vortex-file-compressed 730800639 658468852 1.11
tpch_q18/duckdb:vortex-file-compressed 556161482 537280651 1.04
tpch_q19/duckdb:vortex-file-compressed 477978837 436121585 1.10
tpch_q20/duckdb:vortex-file-compressed 792748997 805289376 0.98
tpch_q21/duckdb:vortex-file-compressed 979853191 1057060391 0.93
tpch_q22/duckdb:vortex-file-compressed 262715598 244789306 1.07
duckdb / vortex-compact (1.051x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 287716473 287500136 1.00
tpch_q02/duckdb:vortex-compact 980931239 900951835 1.09
tpch_q03/duckdb:vortex-compact 618804405 560460851 1.10
tpch_q04/duckdb:vortex-compact 371660398 368420553 1.01
tpch_q05/duckdb:vortex-compact 780574991 768537730 1.02
tpch_q06/duckdb:vortex-compact 345060869 320734180 1.08
tpch_q07/duckdb:vortex-compact 884147573 814297234 1.09
tpch_q08/duckdb:vortex-compact 992474803 1003946311 0.99
tpch_q09/duckdb:vortex-compact 870557104 912883841 0.95
tpch_q10/duckdb:vortex-compact 697523531 675373137 1.03
tpch_q11/duckdb:vortex-compact 522519979 460071475 1.14
tpch_q12/duckdb:vortex-compact 628247062 561609687 1.12
tpch_q13/duckdb:vortex-compact 309396213 345221501 0.90
tpch_q14/duckdb:vortex-compact 357731326 383193999 0.93
tpch_q15/duckdb:vortex-compact 307060753 267723668 1.15
tpch_q16/duckdb:vortex-compact 340316366 320490949 1.06
tpch_q17/duckdb:vortex-compact 673429036 576551973 1.17
tpch_q18/duckdb:vortex-compact 566369792 510724867 1.11
tpch_q19/duckdb:vortex-compact 446041762 413816885 1.08
tpch_q20/duckdb:vortex-compact 778926509 667274544 1.17
tpch_q21/duckdb:vortex-compact 985528617 995913768 0.99
tpch_q22/duckdb:vortex-compact 282489882 274602872 1.03
duckdb / parquet (1.080x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 433319413 421905244 1.03
tpch_q02/duckdb:parquet 1120927988 1072427345 1.05
tpch_q03/duckdb:parquet 1021345245 953600079 1.07
tpch_q04/duckdb:parquet 629849061 634984647 0.99
tpch_q05/duckdb:parquet 1300290577 1176808396 1.10
tpch_q06/duckdb:parquet 440654305 405139858 1.09
tpch_q07/duckdb:parquet 1186089438 1108875416 1.07
tpch_q08/duckdb:parquet 1415099947 1352989312 1.05
tpch_q09/duckdb:parquet 1321310510 1232388224 1.07
tpch_q10/duckdb:parquet 1323299730 1181931164 1.12
tpch_q11/duckdb:parquet 744714325 675954911 1.10
tpch_q12/duckdb:parquet 777479530 617763591 1.26
tpch_q13/duckdb:parquet 948639238 879249721 1.08
tpch_q14/duckdb:parquet 674993594 625126076 1.08
tpch_q15/duckdb:parquet 505340434 501320914 1.01
tpch_q16/duckdb:parquet 660491529 609016169 1.08
tpch_q17/duckdb:parquet 776954502 680643915 1.14
tpch_q18/duckdb:parquet 913450103 809571210 1.13
tpch_q19/duckdb:parquet 816229697 717194709 1.14
tpch_q20/duckdb:parquet 1153035140 1061271104 1.09
tpch_q21/duckdb:parquet 1025271923 989144577 1.04
tpch_q22/duckdb:parquet 526831823 519301101 1.01

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-5.8%, low confidence) · DuckDB No clear signal (+1.4%, environment too noisy confidence)
Vortex (geomean): 0.816x ✅
Parquet (geomean): 0.841x ✅
Shifts: Parquet (control) -15.9% · Median polish -13.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.766x ✅, 8↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚀 131914686 164994409 0.80
appian_q02/datafusion:vortex-file-compressed 🚀 633901269 874806233 0.72
appian_q03/datafusion:vortex-file-compressed 🚀 361915008 499388621 0.72
appian_q04/datafusion:vortex-file-compressed 🚀 46268208506 51719844017 0.89
appian_q05/datafusion:vortex-file-compressed 🚀 267319794 338869875 0.79
appian_q06/datafusion:vortex-file-compressed 🚀 357233763 476949546 0.75
appian_q07/datafusion:vortex-file-compressed 🚀 443316560 660308251 0.67
appian_q08/datafusion:vortex-file-compressed 🚀 2056637490 2580578120 0.80
datafusion / parquet (0.813x ✅, 8↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
appian_q01/datafusion:parquet 🚀 138169155 163705449 0.84
appian_q02/datafusion:parquet 🚀 650737175 803449847 0.81
appian_q03/datafusion:parquet 🚀 352779748 448675406 0.79
appian_q04/datafusion:parquet 🚀 46498523543 52454892668 0.89
appian_q05/datafusion:parquet 🚀 290817228 360253287 0.81
appian_q06/datafusion:parquet 🚀 378694679 470304006 0.81
appian_q07/datafusion:parquet 🚀 457881416 592482715 0.77
appian_q08/datafusion:parquet 🚀 2052432992 2573866452 0.80
duckdb / vortex-file-compressed (0.869x ✅, 7↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 🚀 193962452 221358497 0.88
appian_q02/duckdb:vortex-file-compressed 🚀 616929453 761021065 0.81
appian_q03/duckdb:vortex-file-compressed 🚀 268120672 331064395 0.81
appian_q04/duckdb:vortex-file-compressed 🚀 1350987053 1515200390 0.89
appian_q05/duckdb:vortex-file-compressed 🚀 296320747 348370916 0.85
appian_q06/duckdb:vortex-file-compressed 821229465 845459505 0.97
appian_q07/duckdb:vortex-file-compressed 🚀 359828148 412504281 0.87
appian_q08/duckdb:vortex-file-compressed 🚀 1312673611 1494257153 0.88
duckdb / parquet (0.870x ✅, 5↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
appian_q01/duckdb:parquet 211565397 234248621 0.90
appian_q02/duckdb:parquet 🚀 625439343 770936851 0.81
appian_q03/duckdb:parquet 🚀 300745491 382505329 0.79
appian_q04/duckdb:parquet 🚀 1363049061 1568460281 0.87
appian_q05/duckdb:parquet 🚀 327112570 378416258 0.86
appian_q06/duckdb:parquet 806030615 838902898 0.96
appian_q07/duckdb:parquet 377719607 417697848 0.90
appian_q08/duckdb:parquet 🚀 1315861240 1506152243 0.87
duckdb / duckdb (0.895x ✅, 6↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 🚀 179317579 202328155 0.89
appian_q02/duckdb:duckdb 🚀 563567355 628053584 0.90
appian_q03/duckdb:duckdb 407287123 438475394 0.93
appian_q04/duckdb:duckdb 🚀 1332501397 1495093129 0.89
appian_q05/duckdb:duckdb 🚀 294847345 345143729 0.85
appian_q06/duckdb:duckdb 799084304 825140573 0.97
appian_q07/duckdb:duckdb 🚀 334876979 376128277 0.89
appian_q08/duckdb:duckdb 🚀 1256269338 1474640371 0.85
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.65 MB (-0.1%)
  • vortex-file-compressed: 479.69 MB → 479.69 MB (0.0%)

@github-actions

github-actions Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.4%
Engines: DataFusion No clear signal (+4.9%, environment too noisy confidence) · DuckDB No clear signal (-9.3%, environment too noisy confidence)
Vortex (geomean): 1.089x ➖
Parquet (geomean): 1.116x ➖
Shifts: Parquet (control) +11.6% · Median polish +8.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.155x ➖, 0↑ 4↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 760573377 704858312 1.08
tpch_q02/datafusion:vortex-file-compressed 697598692 649059253 1.07
tpch_q03/datafusion:vortex-file-compressed 761758541 700726786 1.09
tpch_q04/datafusion:vortex-file-compressed 539159423 430440100 1.25
tpch_q05/datafusion:vortex-file-compressed 1002650614 829604525 1.21
tpch_q06/datafusion:vortex-file-compressed 599244523 518567479 1.16
tpch_q07/datafusion:vortex-file-compressed 944126636 881554653 1.07
tpch_q08/datafusion:vortex-file-compressed 1206723744 1271932137 0.95
tpch_q09/datafusion:vortex-file-compressed 1246865617 1224018557 1.02
tpch_q10/datafusion:vortex-file-compressed 900249104 831667767 1.08
tpch_q11/datafusion:vortex-file-compressed 520318662 442205060 1.18
tpch_q12/datafusion:vortex-file-compressed 🚨 927295356 672535989 1.38
tpch_q13/datafusion:vortex-file-compressed 🚨 515711841 386908776 1.33
tpch_q14/datafusion:vortex-file-compressed 🚨 621652017 474911505 1.31
tpch_q15/datafusion:vortex-file-compressed 993798818 833278474 1.19
tpch_q16/datafusion:vortex-file-compressed 🚨 546997588 412429152 1.33
tpch_q17/datafusion:vortex-file-compressed 1270476323 1022983182 1.24
tpch_q18/datafusion:vortex-file-compressed 1168429691 1087859331 1.07
tpch_q19/datafusion:vortex-file-compressed 931751318 751775708 1.24
tpch_q20/datafusion:vortex-file-compressed 917298542 761372908 1.20
tpch_q21/datafusion:vortex-file-compressed 1369072066 1319400170 1.04
tpch_q22/datafusion:vortex-file-compressed 385647983 371094163 1.04
datafusion / vortex-compact (1.170x ➖, 0↑ 7↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 807677505 717329435 1.13
tpch_q02/datafusion:vortex-compact 🚨 958010099 715057955 1.34
tpch_q03/datafusion:vortex-compact 🚨 905821937 689994781 1.31
tpch_q04/datafusion:vortex-compact 505642990 496481105 1.02
tpch_q05/datafusion:vortex-compact 1008993822 848772650 1.19
tpch_q06/datafusion:vortex-compact 658364427 519022681 1.27
tpch_q07/datafusion:vortex-compact 931283353 992570087 0.94
tpch_q08/datafusion:vortex-compact 1161354926 1098116050 1.06
tpch_q09/datafusion:vortex-compact 1105151760 1070306983 1.03
tpch_q10/datafusion:vortex-compact 798651998 964351459 0.83
tpch_q11/datafusion:vortex-compact 446525488 407975534 1.09
tpch_q12/datafusion:vortex-compact 🚨 1128629525 593299557 1.90
tpch_q13/datafusion:vortex-compact 🚨 526198769 372796893 1.41
tpch_q14/datafusion:vortex-compact 🚨 689997306 439055893 1.57
tpch_q15/datafusion:vortex-compact 857428841 780240054 1.10
tpch_q16/datafusion:vortex-compact 383638157 386157378 0.99
tpch_q17/datafusion:vortex-compact 1095581754 1052189179 1.04
tpch_q18/datafusion:vortex-compact 1109018335 1090421265 1.02
tpch_q19/datafusion:vortex-compact 969115566 876036884 1.11
tpch_q20/datafusion:vortex-compact 🚨 1105022396 790741043 1.40
tpch_q21/datafusion:vortex-compact 1376735500 1266419637 1.09
tpch_q22/datafusion:vortex-compact 🚨 473837529 347760231 1.36
datafusion / parquet (1.108x ➖, 0↑ 2↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 857935362 820370059 1.05
tpch_q02/datafusion:parquet 797002315 715232653 1.11
tpch_q03/datafusion:parquet 1001198361 857010101 1.17
tpch_q04/datafusion:parquet 471579973 413690188 1.14
tpch_q05/datafusion:parquet 1193243076 1106256369 1.08
tpch_q06/datafusion:parquet 587605223 517128014 1.14
tpch_q07/datafusion:parquet 🚨 2121654315 1232690909 1.72
tpch_q08/datafusion:parquet 1677575553 1574891002 1.07
tpch_q09/datafusion:parquet 1696203181 1740881992 0.97
tpch_q10/datafusion:parquet 2077458836 2022794287 1.03
tpch_q11/datafusion:parquet 506908878 517977135 0.98
tpch_q12/datafusion:parquet 689550551 612571603 1.13
tpch_q13/datafusion:parquet 675770546 653834300 1.03
tpch_q14/datafusion:parquet 762001511 739895849 1.03
tpch_q15/datafusion:parquet 1226741603 1189135230 1.03
tpch_q16/datafusion:parquet 🚨 475084453 309725779 1.53
tpch_q17/datafusion:parquet 1393389582 1287352435 1.08
tpch_q18/datafusion:parquet 1511709648 1440565138 1.05
tpch_q19/datafusion:parquet 968925730 898143312 1.08
tpch_q20/datafusion:parquet 1093132686 1069829107 1.02
tpch_q21/datafusion:parquet 1863316829 1617546772 1.15
tpch_q22/datafusion:parquet 653227357 641329233 1.02
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 598066097 601126161 0.99
tpch_q02/duckdb:vortex-file-compressed 1142709299 1138962711 1.00
tpch_q03/duckdb:vortex-file-compressed 863372135 805008967 1.07
tpch_q04/duckdb:vortex-file-compressed 608270497 598710028 1.02
tpch_q05/duckdb:vortex-file-compressed 1078496832 1040646542 1.04
tpch_q06/duckdb:vortex-file-compressed 570127652 550016400 1.04
tpch_q07/duckdb:vortex-file-compressed 1155447642 1045365619 1.11
tpch_q08/duckdb:vortex-file-compressed 1374314065 1359090593 1.01
tpch_q09/duckdb:vortex-file-compressed 1577760712 1575397457 1.00
tpch_q10/duckdb:vortex-file-compressed 1071743003 1188931754 0.90
tpch_q11/duckdb:vortex-file-compressed 676459902 583872182 1.16
tpch_q12/duckdb:vortex-file-compressed 1222710446 1098908917 1.11
tpch_q13/duckdb:vortex-file-compressed 796028576 751509781 1.06
tpch_q14/duckdb:vortex-file-compressed 620788338 635171471 0.98
tpch_q15/duckdb:vortex-file-compressed 524520683 560652504 0.94
tpch_q16/duckdb:vortex-file-compressed 458801608 495441605 0.93
tpch_q17/duckdb:vortex-file-compressed 972602299 960308526 1.01
tpch_q18/duckdb:vortex-file-compressed 880267535 847853886 1.04
tpch_q19/duckdb:vortex-file-compressed 797508211 734784031 1.09
tpch_q20/duckdb:vortex-file-compressed 1184269181 1189280190 1.00
tpch_q21/duckdb:vortex-file-compressed 1830119926 1821055768 1.00
tpch_q22/duckdb:vortex-file-compressed 361863789 362539746 1.00
duckdb / vortex-compact (1.020x ➖, 0↑ 0↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 645569889 625686882 1.03
tpch_q02/duckdb:vortex-compact 1150716707 1083708858 1.06
tpch_q03/duckdb:vortex-compact 878194806 751785068 1.17
tpch_q04/duckdb:vortex-compact 575829829 562419161 1.02
tpch_q05/duckdb:vortex-compact 1133893318 1054710605 1.08
tpch_q06/duckdb:vortex-compact 568883745 513770399 1.11
tpch_q07/duckdb:vortex-compact 1111018726 1149232859 0.97
tpch_q08/duckdb:vortex-compact 1354721013 1319529042 1.03
tpch_q09/duckdb:vortex-compact 1571696446 1482645633 1.06
tpch_q10/duckdb:vortex-compact 1098842828 1245058224 0.88
tpch_q11/duckdb:vortex-compact 572241270 672334861 0.85
tpch_q12/duckdb:vortex-compact 1043842260 1055271876 0.99
tpch_q13/duckdb:vortex-compact 717241540 696530096 1.03
tpch_q14/duckdb:vortex-compact 609765590 637844440 0.96
tpch_q15/duckdb:vortex-compact 529262125 547822931 0.97
tpch_q16/duckdb:vortex-compact 437287393 424962203 1.03
tpch_q17/duckdb:vortex-compact 876208695 893210058 0.98
tpch_q18/duckdb:vortex-compact 885829341 795017806 1.11
tpch_q19/duckdb:vortex-compact 719667264 724476274 0.99
tpch_q20/duckdb:vortex-compact 1111278103 1082448749 1.03
tpch_q21/duckdb:vortex-compact 1852519951 1698238798 1.09
tpch_q22/duckdb:vortex-compact 413434024 385504619 1.07
duckdb / parquet (1.124x ➖, 0↑ 1↓)
name PR acebb2f (ns) base c5e075a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 800733278 747770025 1.07
tpch_q02/duckdb:parquet 1361901037 1174258995 1.16
tpch_q03/duckdb:parquet 🚨 1840727630 1403562084 1.31
tpch_q04/duckdb:parquet 1057843426 859251737 1.23
tpch_q05/duckdb:parquet 1955886250 1755935620 1.11
tpch_q06/duckdb:parquet 764282244 706536999 1.08
tpch_q07/duckdb:parquet 1854424962 1555744791 1.19
tpch_q08/duckdb:parquet 2295882182 2149238299 1.07
tpch_q09/duckdb:parquet 2662562096 2226072740 1.20
tpch_q10/duckdb:parquet 3009000367 2816989513 1.07
tpch_q11/duckdb:parquet 959622259 793247038 1.21
tpch_q12/duckdb:parquet 1245042813 1042205430 1.19
tpch_q13/duckdb:parquet 1239372745 1124595161 1.10
tpch_q14/duckdb:parquet 1316126900 1140586652 1.15
tpch_q15/duckdb:parquet 901123466 812409196 1.11
tpch_q16/duckdb:parquet 871733863 844167374 1.03
tpch_q17/duckdb:parquet 1193563749 1221855170 0.98
tpch_q18/duckdb:parquet 1475518067 1312235826 1.12
tpch_q19/duckdb:parquet 1472377359 1339708277 1.10
tpch_q20/duckdb:parquet 1873447649 1624956509 1.15
tpch_q21/duckdb:parquet 1775430867 1585361472 1.12
tpch_q22/duckdb:parquet 1038040002 1016612622 1.02

@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Aug 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/feature A new feature stale This PR is stale and will be auto-closed soon

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@AdamGS